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IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD 
AND PROGRAM DISTRIBUTION MEDIUM AND DATA DISTRIBUTION 
MEDIUM FOR PROCESSING IMAGES 



BACKGROUND OF THE INVENTION 



Field of the Invention 

This invention relates to an image processing device, image processing method, a 
program distribution medium, and a data distribution medium more specifically, this invention 
relates to an im^e processiug device and image processing method, a program distribution 
medixim, and a data distribution medium, by which, for example, an image of detailed shape can be 
generated from rough shapes. 
Description of the Prior Art 

The higher degree of integration and higher speeds achieved in processors and memories 
have made possible what was previously difficult, namely the generation of three-dimensional 
images in real time, making it possible to display three-dimensional images (three-dimensional 
graphics) with a sense of presence for example on video game machines. If a three-dimensional 
image is to be displayed, in many cases the three-dimensional image is broken up into multiple 
polygons (unit graphic forms), and the three-dimensional image as a whole is drawn by drawing 
each of these polygons. Thus it can be said that a three-dimensional image that is drawn in this way 
is defined as a combination of polygons. 

Three-dimensional images are produced by composing three-dimensional shapes with, for 
example, wire frames. However, to compose a wire frame the producer must set detailed 
parameters concerning three-dimensional shapes, which has been troublesome. That is, as a three- 
dimensional shape becomes more complex, the wire frame parameters must also be set in detail, 
which has been troublesome. 



SUMMARY OF THE INVENTION 

It is an object of the present invention to make it possible to generate an image of detailed 
shape from rough shapes. 

To attain the above and other objects the image processing device of the present invention 
comprises an interpolated line computation means for determining an interpolated line that is the 
line which interpolates between two vertices from the interpolation vector and vertex coordinates 
used for determining the line that interpolates a space between a given point and another point in 
the vertices of a unit graphic form, and an interpolated point computation means for deterinining, as 
the vertices of sub-unit graphic forms, interpolated points which are points on the interpolated line. 

An image processing method of the present invention comprises an interpolated line 
computation step of determining the interpolated line which interpolates between two vertices from 
the coordinates of the vertices and an interpolation vector used for determining the line which 
interpolates between one vertex and another in the vertices of a unit graphic form, and an 
interpolated point computation step of determining, as the vertices of sub-unit graphic forms, 
interpolated points that are points on an interpolated line. 

A program distribution medium of the present invention provides a computer program that 
has an interpolated line computation step that determines the interpolated line that interpolates 
between two vertices from the coordinates of the vertices and an interpolation vector used for 
determining the line that interpolates between one vertex and another in the vertices of a unit 
graphic form, and an interpolated point computation step that determines, as the vertices of sub-unit 
graphic forms, interpolated points that are points on an interpolated line. 

According to an embodiment, an image processing device of the present invention 
comprises an operation means that is operated when a unit graphic form is input, and an 
interpolation vector generation means for generating an interpolation vector used for determining 
the interpolated line that is the line that interpolates between a given vertex and another vertex in 
the vertices of a unit graphic form that is input by the operation means being operated. 

An image processing method of the present invention comprises an interpolation vector 



generation step of generating an interpolation vector used for determining an interpolated line that 
is the line that interpolates between a given vertex and another vertex in the vertices of a unit 
graphic form that is input by the operation means which the latter is being operated. 

A program distribution medium according to the present invention provides a computer 
program that has an interpolation vector generation step that generates an interpolation vector used 
for determining the interpolated line that is the line that interpolates between a given vertex and 
another vertex in the vertices of a unit graphic form that is input by the operation means which the 
latter is being operated. 

In a data distribution medium of tMs inventiori, if a uiiit graphic form is input, to^ 
vectors are generated, used for determining an interpolated line which is the line that interpolates a 
space between a given vertex and another vertex in the vertices of the unit graphic form, and the 
data distribution medium provides as data concerning the image, at least the coordinates of the 
vertices thus obtained and the interpolation vectors at the vertices. 

In an embodiment, an image processing device comprises a provision device which 
includes an operation means that is operated when a unit graphic form is input, and an interpolation 
vector generation means that generates interpolation vectors used for deternuriing an interpolated 
line that is the line that interpolates between a given vertex and another vertex in the vertices of the 
unit graphic forms input by the operated operation means, and a client device which has an 
interpolated line computation means for determining the interpolated lines from the coordinates of 
the vertices of the unit graphic forms and from the interpolation vectors, and an interpolated point 
computation means that determines, as the vertices of sub-unit graphic forms, interpolated points 
that are points on the interpolated lines. 

In the image processing device of the present invention, the interpolated line computation 
means determines the interpolated line that is the line that interpolates between two vertices from 
the interpolation vector used for determining the line that interpolates the space between a given 
vertex and another vertex in the vertices of a unit graphic form and from the coordinates of the 
vertices, and the interpolated point computation means determines, as the vertices of sub-unit 



graphic forms, interpolated points that are points on an interpolated line. 

In the image processing method of the present invention, the interpolated line that is the line 
that interpolates between two vertices is determined from the coordinates of the vertices and the 
interpolation vector used for detennining the line that interpolates between a given vertex and 
5 another vertex in the vertices of a unit graphic form, and interpolated points that are points on an 
interpolated line are determined as the vertices of sub-unit graphic forms. 

In the program distribution medium of the present invention, a computer program is 
provided, which detennines the interpolated line that is the line that interpolates between two 
vertices from the coordinates of the vertices and the interpolation vector used for determining the 
10 line that interpolates between a given vertex and another vertex in the vertices of a unit grapW^ 
0 form, and determines, as the vertices of sub-unit graphic forms, interpolated points that are points 
€1 ■ on an interpolated line. 

fli In an embodiment of the image processing device, the operation means is operated when a 

s : 

U unit graphic form is input, and the interpolation vector generation means generates the interpolation 
1 5^' vector that is used to determine the interpolated line that is the line that interpolates between a given 
S| vertex and another vertex in the vertices of the unit graphic form input by the operated operation 
means. 

0 According to yet another embodiment, in the iniage processing rnethod of tMs u 

interpolation vector is generated that is used to determine the interpolated line that is the line that 
20 interpolates between a given vertex and another vertex in the vertices of the unit graphic form input 
by the operation means when the latter is being operated. 

In the program distribution medium of the present invention, a computer program may be 
provided which generates an interpolation vector used for determining the interpolated line that is 
the line that interpolates between a given vertex and another vertex in the vertices of a unit graphic 
25 form that is input by the operation means being operated. 

In the data distribution medium of the present invention, if a unit graphic form is input, by 
generating the interpolation vector xised for determining an interpolated line that is the hne which 
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interpolates between a given vertex and another vertex in the vertices of the unit graphic form, there 
are provided as data concerning the im^e, at least the coordinates of the vertices thus obtained and 
the interpolation vectors at the vertices. 

In yet another embodiment of the image processing device, the operation means is operated 
5 when a unit graphic form is input, and the interpolation vector generation means generates 
interpolation vectors used for determining the interpolated line that is the line that interpolates 
between a given vertex and another vertex in the vertices of the unit graphic form input by the 
operated operation means. The interpolated line computation means determines the interpolated 
Hues jfrom the coordinates of the vertices of the iffiit graphic fonns and from the interp^ 
10 vectors, and the interpolated point computation means determines, as the vertices of sub-unit 
graphic fonns, interpolated points that are points on the interpolated lines. 



fU BRIEF EXPLANATION OF THE DRAWINGS 

M Figure 1 is a diagram that shows an example of the configuration of an embodiment of a 

lf\ data provision system to which the present invention applies; 

S Figure 2 is a block diagram of an embodiment of the data provision device of the system of 

-£ Figure 1; 

5 Figure 3 is a block diagram of an embodiment of the user terminal of the system of Figure 

1; 

20 Figure 4 is a diagram showing polygons and normal vectors, for explaining the computation 

method for interpolated lines according to the invention; 

Figure 5 is a diagram that shows an interpolated line if angles 9^ and 02 between a line 
segment forms with the tangent vectors are equal; 

Figure 6 is a diagram for explaining how control edge lengths Lj and L2 are determined in 
25 the method of the present invention; 

Figure 7 is a diagram for explaining how control edge lengths and L2 are determined; 
Figures 8(A)-8(C) show diagrams for explaining how an interpolated line is determined if 
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angles 9, and 82 are different from each other; 

Figure 9 is a flowchart for explaining control point computation processing; 

Figures 1 0(A) and 10(B) show diagrams of simulation results in which an interpolated line 
is determined; 

5 Figures 11 (A) and 1 1 (B) show diagrams of simulation results in which an interpolated line 

is determined; 

Figures 12(A) and 12(B) are diagrams showing simulation results in which an interpolated 
line is determined; 

Figure 13(A) and 13(B) are diagrams which show simulation results in which an 

10 interpolated line is determined; 

Figure 14 is a diagram for explaining how an interpolated line is determined for a polygon 
^ that comprises a toee-dimensional shape; 

^ FigiH-e 1 5 is a diagram for explaining fine splitting processing; 

Til 

W Figure 1 6 is a diagram for explaining how a normal vector at a vertex of a sxabpolygon is 

15g detemiined; 

Figure 1 7(A) and 1 7(B) are diagrams for explaining the difficulties in fine splitting 
processing if only normal vectors at vertices are used as interpolation vectors; 

Figure 1 8 is a diagram for explaining the difficulties in fine splitting processing if only 
U normal vectors at vertices are used as interpolation vectors; 
20 Figure 19(A)-19(D) are diagrams for explaining fine splitting processing if both curved 

surface interpolation nomial vectors and frame line interpolation normal vectors are adopted as 

interpolation vectors; 

Figure 20 is a flowchart for explaining splitting polygon data generation processing; 

Figure 21 is a diagram for explaining the processing of step S14 in Figure 20; 
25 Figure 22(A) and 22(B) are diagrams that show how Bezier curves as frame lines that 

constitute a three-dimensional shape are drawn in sequence; 

Figure 23 is a diagram for explaining frame line interpolation noraial vectors (normal 
vectors of frame lines); 
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Figure 24 is a diagram for explaining the processing of step S 1 6 in Figure 20; 

Figure 25(A) and 25(B) are diagrams that show interpolated lines obtained using frame line 
interpolation normal vectors and interpolated lines obtained using curved surface interpolation 
normal vectors; 

Figure 26(A)-26(D) diagrammatically show the format of the splitting polygon data; 
Figure 27 is a flowchart for explaining fine splitting processing; 
Figure 28 is a diagram for explaining fine splitting processing; 
Figure 29 is a diagram for explaining the processing of steps S21 and S22 in Figure 27; 
Figure 30 is a digram for explaining the processing of steps S23 and S24 in Figure 27; 
Figure 3 1 is a diagram for explaining the processing of step S25 in Figure 27; 
Figure 32 is a diagram for explaining the processing of step S26 in Figure 27; 
Figure 33 is a diagram for explaining the processing of step S25 in Figure 27; 
Figure 34 is a flowchart for explaining splitting processing of frame lines; 
Figure 3 5 is a flowchart for explaining splitting processing in the interior of a polygon; 
Figure 36 is a digram that shows polygons that constitute a cube to be subjected to fine 
splitting processing; 

Figure 37 is a photograph of a halftone image appearing on a display that shows the 
drawing results if fine splitting processing is not done on the polygons of Figure 36; 

Figure 38 is a photograph of a halftone image appearing on a display that shows the 
drawing results if fine splitting processing is done on the polygons of Figure 36; 

Figure 39 is a diagram that shows an example of generation of a squashed sphere (side 
views) at the state in which the interpolation normal vectors assigned to a cube to be subjected to 
fine splitting processing are modified; 

Figure 40 is a photograph of a halftone image appearing on a display that shows the 
drawing results if fine splitting processing is done on the polygons of Figure 36; 

Figure 41 is a photograph of a halftone image appearing on a display that shows the 
drawing results if fine splitting processing is done on the polygons of Figure 36; 

Figure 42 is a photograph of a halftone image appearing on a display that shows the 
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drawing results if fine splitting processing is done on the polygons of Figure 36; 

Figure 43 is a flowchart for explaining the processing of user terminal in Figure 3; 

Figure 44 is a block digram that shows an example of the electric configuration if the user 
terminal is configured as a video game machine; and 

Figure 45 is a block dis^am that shows an example of the configuration of the graphic 
memory in Figure 44. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The symbols designating various parts of the present uiventions are as follows: 
1 is a data provision device, 2 is a transmission medium, 3 is a recording medium, 4 is a 
user terminal, 11 is an input unit, 12 is a data processing unit, 12A is a memory, 13 is a splitting 
database, 14 is a splittmg processing unit, 15 is a rendering unit, 16 is display unit, 17 is a texture 
database, 18 is a transmission/recording device, 21 is a reception/playback device, 22 is a splitting 
database, 23 denotes a geometry processing unit, 24 designates a splitting processing unit, 25 is a 
rendering unit, 26 is a display unit, 27 is a texture database, 28 is a main unit, 101 is a main bus, 
102 is a sub bus, 11 1 is a main CPU, 1 12 is a main memory, 1 13 is a main DMAC, 1 14 is MDEC, 
llSisGPU, 116 is a bus controller, 117isGTE, 118 is a graphic memory, 119 is a cache memory, 
121 is a sub CPU, 122 is a sub memory, 123 is sub DMAC, 124 is ROM, 125 is SPU, 126 is ATM 
communication unit, 127 is an auxiUary memory device, 128 is an input device interfece, 129 is a 
sound memory, 141 is a frame buffer, 142 is an Z buffer, 143 is a texture memory. 
Referring now to the drawings in detail 

Figure 1 shows an example of a data provision system to which this invention applies 
("system" means an aggregate in which multiple devices are collected together logically, regardless 
of whether the constituent devices are in the same housing). 

In this data provision system, three-dimensional image data generated on the side of a data 
provision device 1 is provided to a user terminal 4. 

That is, data for three-dimensional images, such as data about polygons that constitute a 
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three-dimensional shape, is generated by the producer on data provision device 1 , and it is provided 

to user terminal 4 by being transmitted via a transmission medium (transmission route) 2, for 

example, via Internet, satellite circuit, ground wave, cable television (CATV) network, public 

switched telephone network (PSTN), or integrated service digital network (ISDN). Or, 

5 alternatively, data for three-dimensional images generated by data provision device 1 is provided to 

user terminal 4 by being recorded on recording medium 3 , for example, on optical disk, 

optom^etic disk, magnetic disk, magnetic tape, or phase-change disk. 

At user terminal 4, the data provided from data provision device 1 as described above is 

processed, and a three-dimensional image is displayed. 
10 Figure 2 shows an example ofthe configuration of data provision devicel of Figure 1. 

m Input unit 1 1 , which is a keyboard, mouse, tablet, or similar device, is operated when data 

|{ for producing the polygons that constiUite a three-dinaensional shape is to be input, 
f ; to be mapped onto the polygons is to be specified, and when necessary commands, etc. are to be 
W input Here, data for producing the polygons that constitute the three-dimensional shape that is 
1 5# input by input unit 1 1 being operated is supplied to data processing unit 12, the specification of the 
0 texture to be mapped onto the polygons is supplied to rendering unit 15, and commands are 
111 supplied to the necessary block. 

m Data processing unit 12 generates the coordinates of the vertices on the polygons in three- 

dimensional space, as well as the below-described interpolation vector at each vertex, by 
20 processing, using memory 1 2A if necessary, the data for producing the polygons that is supplied 
from input unit 1 1 , and supplies them to spHtting database 1 3 . Here the coordinates of the vertices 
of the polygons and the interpolation vectors are used for splittii^ processing of the polygons, 
which is described below, so m the following, for convenience, these are both referred to as 
splitting polygon data. 

25 Memory 12A temporarily stores the data needed for processing by data processing unit 12. 

Splitting database 13 temporarily stores the splitting polygon data from data processing unit 12. 
Splitting processing unit 14 reads the splitting polygon data that is stored in splitting 
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database 13, performs splitting processing (fine splitting processing), which is discussed below, 
splits rough polygons into multiple fine polygons (hereafter referred to, for convenience, as 

subpolygons), and supplies them to rendering unit 15. 

Rendering unit 15 performs rendering processiQg on the subpolygons from splitting 

processing unit 14. That is, rendering unit 15 performs on the subpolygons brightness calculations, 
etc. for shading, and converts the coordinate system of the polygons in three-dimensional space into 
the coordinate system (screen coordinate system) of display unit 16 as a two-dimensional output 
device that displays three-dimensional images. Also, using the texture data stored in texture 
database 17, rendering unit 15 carries out calculation of the texture address for texture mapping, 
determines the final RGB values (the brightness values of the R (red) component, G (green) 
component, and B (blue) component) of each pixel that comprises display unit 16, and outputs 
them to display unit 16. The textures for texture mapping are specified by, for example, input unit 
1 1 being operated. 

Display unit 1 6, which is for example a cathode ray tube (CRT) or Uquid crystal display, 
displays the pixels that correspond to the RGB values from rendering unit 15. Texture database 17 
stores data on textures to be used for texture mapping. Transmission/recording device 1 8 reads the 
splitting polygon data stored in splitting database 13, reads the texture data stored in texture 
database 17, and transmits it via transmission medium 2 or records it in recording medium 3 . 

Next, Figure 3 shows an example of the configuration of user terminal 4 of Figure 1 . 

The user terminal includes a reception/playback device 2 1 which receives data that is 
transmitted via transmission medium 2 or plays back the data that is recorded in recording medium 
3, and among this it supplies the spUtting polygon data to a splitting database 22 and the texture 

data to a texture database 27. 

Splitting database 22 temporarily records the splitting polygon data from 

reception/playback device 21. A geometry processing unit 23 reads the splitting polygon data 
stored in splitting database 22, does geometry processing on the input from input unit 28, that is, 
performs coordinate conversion, clipping, etc., and supplies it to a splitting processing unit 24. 
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Splitting processing unit 24, or rendering unit 25, to which its output is supplied, carries out 
the same processing as in the case of splitting processing unit 14 or rendering unit 15, respectively, 
which forms part of data provision device 1 in Figure 2. A display unit 26 is constituted in the 
same way as display unit 16, which forms part of data provision device 1 in Figure 2, and it 
displays a three-dimensional image that corresponds to the RGB values from rendering unit 25. 

Texture database 27 stores the texture data from reception/playback device 2 1 . This texture 
data is used for the texture mapping done by rendering unit 25. 

Input unit 28 is for example a keyboard, mouse, joystick, buttons, etc. and is operated by the 
user when a prescribed input (for example, in particular, information about the viewpoint) is to be 
input 

Next, the processing in data provision device 1 of Figure 2 will be described and in user 
terminal 4 of Figure 3. However, first the polygon splitting processing done in spHtting processing 
unit 14 will be described, which forms part of data provision device 1 of Figure 2, and in spUtting 
processing unit 24, which forms part of user terminal (client terminal) 4 of Figure 3. 

If a three-dimensional shape in a three-dimensional image is represented by polygons, the 
three-dunensional shape can be reproduced with greater fidelity by using finer polygons. However, 
if fine polygons are used, the number of polygons that represent the three-dimensional shape 
increases, so one must set all the data for these many polygons, which is troublesome; in addition, 
the quantity of data becomes greater. 

On the other hand, if a three-dimensional shape is represented by a small number of 
polygons, a small quantity of data to be set suffices, but the reproduced three-dimensional shape 
then becomes coarse, which degrades the quality of the three-dimensional image. 

In the polygon splitting that is generally done, a number of fine polygons that make up a 

three-dimensional shape are assembled to form a large polygon, and the large polygon and the 
original fine polygons are selected as necessary, so the data that must be set when constittitmg a 
three-dimensional shape is no different from the case in which the three-dimensional shape is 
constituted by fine polygons. 
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In the polygon splitting that is done in splitting processing units 14 and 24 (called 
hereinafter fine splitting processing to distinguish it from conventional polygon splitting), from the 
beginning a rough polygon is split into detailed (fine) polygons so as to give a smooth three- 
dimensional shape, and even if detailed data about the three-dunensional shape to be realized is not 
5 given in this way, a delicate three-dimensional shape can be obtained by simply giving, so to speak, 
rough data. 

That is, splitting processing units 14 and 24 are given, as splitting polygon data, at least the 
interpolation vectors, and the coordinates of the vertices, for determining the line that interpolates 
between a given vertex and another vertex in the vertices of the polygon, and in fine splitting 
10 processing, interpolated lines that are the lines that interpolate between two vertices are determined 
M firom the interpolation vectors and the coordinates of the vertices, and interpolated points that are 
i pomts on a given interpolated line are determined as the vertices of subpolygons into which the 
ftj original polygon is split. 

B Here, as data for a three-dimensional image composed of polygons, generally the 

if coordmates of the vertices of a polygon are given for specifying the shape of the polygon. For 

shading, the normal vector at each vertex of the polygons of a curved surface that makes up part of 
a three-dimensional shape to be reaUzed by polygons is also given as data for the three-dimensional 
image. 

In fine splitting processing, the normal vectors at the vertices of the polygons are used as 
20 interpolation vectors, and the interpolated Unes that interpolate between two vertices are 
determined. 

That is, in order now to simplify the explanation, given, as shown in Figure 4, two vertices 
P, and of a polygon that makes up part of a two-dimensional shape, and normal vectors ni and n, 
at vertices P, and Pj, respectively, we describe the method for calculating the interpolated line that 
25 interpolates between vertices P, and Pj in this case. 

In this embodiment, it is taken to be ideal for the interpolated line to be equal to the arc of a 
circle or ellipse that passes through the two vertices that the interpolated line interpolates, and such 
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an interpolated line is to be determined. Here, ail smooth curves can be approximated by a 
succession of minute arcs (including arcs of both circles and ellipses), so here one adopts as 
interpolated lines curves that are represented by fimctions that can approximate an arc. 

As shown in Figure 5, given normal vectors at vertices P, and P, of a two-dimensional 

5 shape that passes through vertices P, and Pj (since normal vectors n, and are perpendicular to the 
two-dimensional shape, tangent vectors can be determined from these normal vectors n, and n2), 
the angle that Une segment PjP^ joining vertices P, and P^ forms with the tangent vector at vertex Pj 
or P2, is denoted by 6, or 62, respectively. In this case, if and 82 are equal, the arc of a circle that 
passes through both vertices P, and P2 can be taken as the interpolated line. 

10 The curve that is taken as the interpolated Une is selected with the relationship between 9i 

P and 02 as a condition: for example, if 9, and are equal, for example an arc of a circle that passes 

ii through both vertices P, and P2 is taken as the interpolated line; if Gi and Gj differ by a small 

m- amount, for example an arc of an ellipse that passes through both vertices P, and P2 is taken as the 

U interpolated line; and if G, and 83 differ by a large amount, for example a spline curve that passes 

1 ¥ through both vertices Pi and Pj is taken as the interpolated Une. Thus sometimes the interpolated 

S Une does not vary continuously when the relationship between 9, and 92 varies. 

Ila! 

^- Thus here, for example, a Be2der curve is adopted uniformly as the interpolated line 

0 regardless of the relationship between 9, and 82 (strictly speaking, there should be an acute accent 
over the "e" following the "B" in "Bezier"). The order of the Bezier curve is set to, for example, 3, 

20 so that arbitrary G, and G2 can be given. 

A third-order Bezier curve is specified by four control points, two of which coincide with 

the starting point and ending point of the Bezier curve. The other two control points lie on the 

tangent at the starting point and ending point of the Bezier curve, respectively. 

Meanwhile, because the tangent vector at vertex P, or Pj is determined based on normal 

25 vector n, or n.^, respectively, the tangent direction of the Bezier curve that passes through vertex P , 

or P2 is specified by giving normal vector n, or n^. And the starting point or ending point of the 

Bezier curve that is the interpolated line is given by vertex P, or P2 (or P2 or P,), respectively. 
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Therefore the third-order Bezier curve as the interpolated line that interpolates between vertices P, 
and P2 is specified uniquely if one determines a control point in the direction of the tangent vector 
at vertex ?! or P2, respectively. 

In Figure 6, 1 is normal direction, 2 is length L„ 3 is tangent vector, 4 is an interpolated 
5 line (Bezier curve), 5 is tangent vector, 6 is length Lj, 7 is normal direction. In the situation 
shown in Figure 6: Q, is a control point in the direction of the tangent vector at vertex Pi, Q2 is a 
control point in the direction of the tangent vector at vertex P^, aod the length L, of line segment 
PiQ, and the length of line segment P2Q2 are determined (in the following, for convenience, Lj 

and L2 are referred to as control edge lengths). 
10 First, the third-order Bezier curve B that serves as the interpolated line is expressed by the 

6! following equation using parameter t (0 # t # 1) and (the coordinates of) the four control points P„ 

1 P2,Ql,Q2- 

P-! B = (l-t)^P,+3(l-t)^Q,+3(l.t)t^Q2 + fP2 ...(1) 

Now ifin Figure 6 we set 61 = 02 = then since as stated above it is ideal here that the 

1 5" interpolated line be an arc of a circle, the situation shown in Figure 7 results if Figure 6 is rewritten 
S so that, for example, the origin is taken as the center C of the circle and line segment P1P2 is parallel 

2 to the X-axis. In Figure 7, 1 is length Lj, 2 is interpolated line, 3 is Y-axis, 4 is length L2, R 

u. represents the intersection point of the y-axis and the arc of the circle that is the interpolated line, 

and this intersection point R can be determined by setting t = 0.5 in equation (1). Here, line 

20 segment RC is the radius of the arc of the circle that is the interpolated line, and in this case, 

because center C lies at the origin, the radius of the circle is R. 

If the interpolated line is an arc of a circle, control edge lengths Li and L, will be equal, so 

setting this to L (= L, = U}, from Figure 7 the following equations holds true. 

P,y = Pjy = R cos 9, Q„ = Qzy = Ply + L sin 9 ... (2) where P,y, Q,y are the y-coordinates of 

25 control points P„ Q„ and Pjy, Qzy are the y-coordinates of control points P2, Q2, respectively. 

Also, intersection point R is expressed by the following equation by setting t to 0.5 in 

equation (1) and substituting the P,y, P2y, Q,y, Qzy of equation (2) for P„ P^, Q„ Q,. 
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R = Rcos0/4 + 3/4(Rcos6 + Lsin0) -..(3) 

As shown by the following equation, the length L' (= L/(2 R (2 R sin 8) of the control edge 

when the length of chord PiPj is normalized to 1 can be determined by solvit^ equations (2) and (3) 

for control edge lei^ L and dividing it by the length (2 R sin 9) of chord PiP^. 

5 L' = 2/(3(1+ cos 6)) -(4) 

After control edge length U is deterinined from equation (4), by using this control edge 

length L' and vertex P, or Pj, control point Q, or Qj, respectively, can be determined, and therefore 
the Bezier curve is specified as the interpolated line. 

In the foregoing, 9, and 92 are equal, but even if 9, and 9^ are different, by performing a 
1 0 transformation to expand/contract one axis, control points Q, and Q2 can be determined hi the same 

way as if 9, and ©2 are equal. 

1 That is, if 01 and 92 are different, as shown in Figure 8(A), the triangle fiDrrnedb 

W and P2 and mtersection point F where the tangents at vertex P, or P2 intersect with each other will 
be a scalene triai^le (whereas in the case in Figure 7 it is an isosceles triangle), and here the length 
IV of side P,F or P2F of this scalene triangle are denoted by kj or kz, respectively. Also, the length of 
g side P,P2 is denoted by K. 

% In this case, the following equations hold true. 

2 ki sin 01= k2 sin 02, k, cos 01 + k, cos 02 = K... (5) 

Also, K can be determined from the coordinates of vertices Pi and 
20 P2. 

Solving equations (5) for k, and k,, we get the following eqiiations. 

ki = K sin 02/(sin 02 cos 9, + cos 92 sin 9,) 

k2 = K sin 0,/(sin 02 cos 9, + cos 92 sin 9,) ... (6) 

MeanwWle, if for example as shown in Figure 8(B), denoting by V the perpendiciilar 
25 dropped from point P2 to straight line P,P', if point P2 is moved along perpendicular V so as to 

deform triangle PiPj?' into triangle PjPz'P' (expansion transformation or contraction transformation) 
as shown m Figure 8(C), then the ratio of control edge length from control point P2 to in 
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triangle PiPjP' before the deformation to control edge length L^' from control point Pj' to Qj' in 
triangle PiPj'P' after the deformation will be equal to the ratio of length of side P2F in triangle 
PiPjP' before the deformation to length of side P^T' in triangle PjPz'F after the deformation, and 
as a result, the following equation holds true. 

Therefore if triangle PiPz'P' after the deformadon is made into an isosceles triangle in which 
the length of side P,P' and the length of side P^T' are equal (but in order to make triangle PiPa'P', 
after a deformation by an expansion/contraction transformation of one axis, into an isosceles 
triangle, e, and 62 must be formed on the same side of chord PjPj), then control edge length can 
be determined by equation (4), and control edge length Lj can be determined from equations (6) 
and (7). That is, control edge length L2 can be determined by the following equation. 

L2 = Kxk2x2xcos9'x2/(3(l+cos0')) ...(8) 

Similarly, control edge length L, can be determined by the following equation. 

L,=Kxk,x2xcose'x2/(3(l + cose')) .-(9) 

The 9' in equations (8) and (9) denotes the angle formed between side P1P2 and side PjT' in 
triangle PiPj'F after the deformation (82 in Figure 8(C)) (or the angle formed by side PiPj and side 

P,P' (G,- in Figure 8(C)) (0, = Gj). 

After control edge length Lj or has been determined as described above, control point 
or Q2 can be determined from vertex P, or Pj, respectively, and thereby the Bezier curve is specified 

as the interpolation line. 

Although 9' can be accurately determined by expressing the contraction transfomaation with 
a numerical expression, in this embodiment, in order to reduce the increase in the amount of 
calculation, cos G' is approximated by s in the following equation. 

cos 9' s = (cos 9, + cos G2)/2 ... (10) 

In this case, control edge lengths L, and 1^ are determined according to the following 

equations. 

L,=Kxk,x2xsx2/(3(l+s)) 
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L2 = Kxk2x2xsx2/(3(l+s)) ...(11) 

Next, refemng to the flowchart in Figure 9, the method will be described for calculating 
control points Qi and (control point computation processing) for specifying the Bezier curve that 
is the interpolated line. 

5 In computing control points Q, and Q2, first, in step S 1 , length k, or of side P,P' or PjP' of 

triangle PjPjP' in Figure 8(A) is determined according to equation (6), then one proceeds to step S2. 
In step S2, the approximate value s of the cosine of base angle 6' (= 9,' = Q^) when triangle P.P^P' is 
deformed, by performing an expansion/contraction transformation, to isosceles PiPz'P' as shown in 
Figure 8(C) is determined according to equation (10), then one proceeds to step S3. In step S3, 
10 equations (1 1) are calculated to detennine control edge lengths L, and Lj, thereby determining 
.% ^ control points Q, and Q2- 

Figures 10 through 13 show the results of simulations in which K = 1 is set, control points 
Qi and are determined, and the interpolated line is determined that is the Bezier curve specified 
by these control points Q, and Qj. In Figures 10 through 13, (A) shows the radius of curvature of 
1$ the interpolated line, and (B) shows the shape of the interpolated Une. Also, Figure 10 shows the 
case where 9, = Oj = 18 degrees, Figure 1 1 shows the case where 9, = 18 degrees and 9^ = 22 
degrees. Figure 12 shows the case where 9, = 28 degrees and 9^ = 32 degrees, and Figure 13 shows 
'yf the case where 9, = 20 degrees and 02 = 60 degrees. 

The foregoing concerns a polygon that is part of a two-dimensional shape, but for a polygon 

20 that is part of a three-dimensional shape, the normal vectors n, or at its two vertices P, or P2 are 
in general in mutuaUy twisted positions. As shown in Figure 14, the angle formed by line segment 
P,P, and the projection (orthogonal projection) of this line segment P,P2 onto the plane A which is 
perpendicular to nonnal vector n, and includes vertex P, is adopted as the 9, in equations (6) and 
(1 0). That is, the unit vector in the direction of the projection of Mne segment P,P2 onto the plane 

25 including vertex P, that is perpendicular to normal vector n, is taken as the tangent vector B of the 
three-dimensional shape at vertex P„ and the angle formed by this tangent vector and line segment 
PiP, is taken as the 9i in equations (6) and (10). 
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Similarly, the angle formed by Ime segment P,p2 and the projection of tMs 1^^ 

PjPj onto the plane C including vertex Pj that is perpendicular to normal vector nj is taken as the 

in equations (6) and (10). 

In the following, as explained in Figure 9, by detennining control points Q, and Q2, the 

5 Bezier curve can be detennined as the interpolated line that interpolates between vertices P, and Pj. 
In this case, the Bezier curve as the interpolated line is generally a curve that is spatially twisted, 
but because the bulge is near to that of a circle or ellipse, ultimately it interpolates smoothly 

between vertices P, and P2. 

After the interpolated line is determined as described above, in fine splitting processing, as 
10 stated above, interpolated points on a given interpolated line are detennined as vertices of 
5 subpolygons into which the original polygon is split, and these interpolated points can be 
€1 determined by inputting an appropriate value for parameter t in equation (1), which expresses the 
fil Bezier curve as the interpolated line. 

P The interval between vertices P, and Pj can be split into M parts by setting M-1 interpolated 

l^: points between them, and if this is done, then it suffices to calculate equation (1) with parameter t 
(pj set to, for example, i/M (i = 1, 2, M-1). 

Next the case, as shown for example in Figure 1 5, will be described in which four vertices 
p P, through P4 are shown, and fine splitting processing is done on quadrilateral polygon P1P2P4P3 
is part of a three-dimensional shape and in which line segments P,P2 and P3P4 lie opposite each 
20 other, and line segments PjPj and P2P4 lie opposite each other. 

Assuming now that the interval between vertices P, and P2 is split into, for example, two 
parts (in this case, the interval between vertices P3 and P4, which lies opposite line segment PiPj, is 
also split into two parts), as explained in Figure 9, interpolated line B^ (interpolated line 1), which 
interpolates between vertices P, and Pj, is determined, and interpolated line B34 (interpolated line 2), 
25 which interpolates between vertices P3 and P4, is determined. And interpolated point P12 or P34 can 
be determined on interpolated line B,2 or B34 by computing equation (1) with parameter t set to, for 
example, 0.5. 
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In this way, quadrilateral polygon P,P2P4P3 is split into two subpolygons, the quadrilateral 

polygons P,Pi2P34P3 and Pi2P2P4P34- 

And if the interval between vertices P, and P3 and the interval between vertices P2 and P4 are 
each split into two parts, then, likewise as explained in Figure 9, interpolated line (interpolated 
5 line 3), which interpolates between vertices Pi and P3, is determined, and interpolated line B24 

(interpolated line 4), which interpolates between vertices P2 and P4, is determined. And interpolated 
point P,3 or P24 can be determined on interpolated line B,3 or B24 by computing equation (1) with 
parameter t set to, for example, 0.5. 

And in this case, interpolated Une B^23i (interpolated line 5), which interpolates between 
1 0 interpolated points P,2 and P34, which were previously determined as the vertices of subpolygons, is 
0 also determined as explaiaed in Figure 9. And interpolated point P1324 can be determined on 
f interpolated line 8,334 by computing equation (1) with parameter t set to, for example, 0.5. 
ry In this way, quadrilateral polygon P1P2P4P3 is split into four subpolygons, the quadrilateral 

C= polygons PiPi2Pl234Pl3. Pl2P2P24,Pl234, P1234P24P4P34, ^^d Pi3Pl234P34P3- 

I V Here quadrilateral polygon P1P2P4P3 is split into 2x2 (horizontal x vertical) subpolygons, but 

5 if quadrilateral polygon P,P2P4P3 is to be split into MxN subpolygons, it suffices to split the interval 

between vertices and P2 and the interval between P3 and P4 each into M parts, split the interval 
between vertices Pj and P3 and the interval between P2 and P4 each into N parts, and split into N 
parts the interval between corresponding members of the M-1 interpolated points that split the 

20 interval between vertices Pi and P2 into M parts and the M [sic; should be M-1] interpolated points 
that split the interval between vertices P3 and P4 into M parts. But quadrilateral polygon P1P2P4P3 
can also be split into many subpolygons by repeating a process in which quadrilateral polygon 
PJP2P4P3 is split by fine splitting processing into two subpolygons PiP|2P34P3 P12P2P4P345 and 
these two subpolygons P1P12P34P3 P12P2P4P34 are each split by fine splitting processing into two 

25 further subpolygons. 

In fine processing, since the interpolated line that interpolates between two vertices is 
determined using the coordinates and normal vectors of the two vertices, in determining 
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interpolated line 8,234 that interpolates between interpolated points P12 and P34, for example in the 
case illustrated in Figure 1 5, it is necessary to have normal vectors n^ or n34 at interpolated points 
P12 or P34, respectively. And even if an interpolated point with another interpolated point is an 
interpolated point that cannot be determined (in the case of Figure 1 5, interpolated points P,3, P24, 
5 P,234), because the interpolated point is the vertex of a subpolygon, a normal vector is needed to do 
shading in rendering processing. 

A normal vector at a vertex of a subpolygon (except a vertex of the original polygon) is 
determined here for example as follows. 

Namely, taking the example of interpolated point P,2 that splits the interval between vertices 
10 Pi and P2, its normal vector n,2 is determined, as shown in Figure 16, by linear interpolation using 
w normal vector n, at vertex P, and normal vector at vertex Pj. 

w SpecijScally, if parameter t that is substituted in equation (1) when interpolated point P12 on 

K interpolated line is to be determined is set to T, then unit vector nn^, which corresponds to the 
P sum of (1 -T) times normal vector n, plus TT times normal vector nj is determined according to the 
15^ following equation. 
I mi,2 = ((1-T)n, + Tn2y|(l-T)n, + Tn2| ... (12) 

:l; where lx| represents the norm of vector X. 

p The vector nni2 obtained by equation (12) is equal to the normal vector determined in Phong 

shading. 

20 Vector mii2 adopted without modification as normal vector n^2 interpolated point 

but because vector xm^2 obtained by linear interpolation using normal vectors n, and n^, it is 
difficult to say that it faithfully reflects the shape of interpolated line B^. So here we correct vector 
nni2 as follows, and adopt the corrected vector as normal vector n^2 at interpolated point P^^. 

That is, first we determine tangent vector of interpolated line 8^2 at interpolated point P12. 
25 Here tangent vector s^j can be determined firom equation (1). 

Then we determine the vector product Tm^2 of vector rm^2 and tangent vector 3^2 according to 

the foUovraig equation. 
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nn^j nni2 X -(13) 

Then we determine the vector product of tangent vector s^2 vector nn^j and set this to 
normal vector n^2 interpolated point as shown in the following equation. 

n,2 = s^2xnni2' -(14) 
Here the "x" in equations (13) and (14) represents a vector product 

Because normal vector n^j determined as described above faithfully expresses the shape of 
interpolated Ime B12, which is a Bezier curve, by using this in shading (highlight calculation, etc), 
we can obtain an image whose brightness distribution accurately reflects the shape of interpolated 
line B12. 

As described above, with fine sphtting processing the normal vector is used as an 
interpolation vector, the interpolated line that interpolates between two vertices is determined from 
the normal vectors and the coordinates of the vertices, and an interpolated point on a given 
interpolated line is determined as the vertex of a subpolygon into which the original polygon is 
split, so one can compose a deUcate three-dimensional shape from polygons of rough shape. 

And because the locality of the interpolation is preserved here, that is, because for example 
in Figure 1 5 each normal vector of an interpolated point that splits the interval between vertices Pi 
and P2 is determined from normal vector n^ at vertex Pj and normal vector Us at vertex P2, the 
subpolygons obtained by splitting quadrilateral polygon P1P2P4P3 ^nd the subpolygons obtained by 
splitting another polygon that abuts quadrilateral polygon P1P2P4P3 at its side P1P2 are connected 
continuously, and thus a smooth three-dimensional shape can be obtained. 

In the case described above, a quadrilateral polygon has been considered. However, fine 
splitting processing can also be done on a polygon that has a different number of sides than four. 
For example, if done on a triangular polygon, fine splitting processing can be done on a triangular 
polygon in the same way as on a quadrilateral polygon by thinking of one of the pairs of vertices P^ 
and P2, P3 and P4, Pi and P3, or P2 and P4 that make up the aforesaid quadrilateral polygon P1P2P4P3 
as being the same vertex. 

Here, texture coordinates at the vertices of the subpolygons are required for doing texture 
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mapping on the subpolygons that result from fine splitting processing, but these can be determined 
in the same way that, for example, noraial vector nn^ at interpolated point is determined, as 
explained in Figure 1 6. That is, although it was not stated above, the data on the three-dimensional 
image that is generated in data provision device 1 includes, besides splitting polygon data and 
texture data, the texture coordinates at each vertex of the original polygons; for example, the texture 
coordinates at interpolated point P12, which splits Uie interval between vertices and Pj, can be 
determined by adding (linearly interpolating) the texture coordinates at vertex Pi and the texture 
coordinates at vertex P2 in accordance with the ratio l-t:t corresponding to parameter t substituted in 
equation (1) for determining interpolated point Pjj. 

If the shape of the interpolated line B^j between vertices Pj and Pj is biased (for example, if 
the radius of curvature of the part near one or the other of vertex P^ or Pj is large, and the radius of 
curvature of the part near the other is small), there will arise distortion in the texture if texture 
mapping is done using the texture coordinates determined by linear interpolation as described 
above. That is, if parameter t substituted in equation (1) for determining interpolated point P12 
assumes, among the values it may assume, for example its midpoint value 0.5, but because of the 
shape of interpolated line B12 is biased, interpolated point is set in a position where its distance 
along interpolated line B12 is very close to, say, vertex Pj between vertex P^ or P2, then texture 
distortion will arise if texture mapping is done using the texture coordinates determined by linear 
interpolation. 

In cases where such texture distortion is a problem, it suffices to do curvilinear integration 
along interpolated line B^, determine the distance along interpolated line B12 from vertex P^ or P2, 
respectively, to interpolated point P^j, and, according to this distance correct the ratio that is used 
when the texture coordinates at interpolated point P^j are determined by linear interpolation. That 
is, it sufi&ces to make a correction whereby the ratio that is used when the texture coordinates at 
interpolated point P12 are determined by linear interpolation is made to approach (or set equal to) 
the ratio between the distance along interpolated line B^2 from vertex P^ to interpolated point P12 
and the distance along interpolated line frona vertex P2 to interpolated point P^. 
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Next, in many cases a smooth tteee-dimensional shape can be redized by doing 
splitting processing using the noimal vectors at the vertices as the interpolation vectors, but 
depending on the three-dimensional shape to be realized, it is sometunes inadvisable to use only the 

normal vectors at the vertices as the interpolation vectors. 
5 That is, there are for example cases where, with a circular cylinder or other body of 

revolution made by rotating a plane shape about an axis of rotation, or a similar three-dimensional 
shape, there is a large discrepancy between the direction of the orthogonal projection of the line 
segment that joins a given vertex a of a polygon that is part of the three-dimensional shape and 
another vertex b (where vertex b is a vertex that is adjacent to vertex a) onto the plane that is 
1 0 perpendicular to the normal vector at vertex a, and the tangent direction (hereafter caUed, for 
i convenience, the frame line direction) at vertex a of the curve (hereafter caUed, for convenience 

f frame line) that joins vertices a and b along the three-dimensional shape to be realized; in such a 
case, if fine splitting processing is done as described above, then the interpolated line that joms 
U vertices a and b will, so to speak, be in a bent state, and if texture mapping is done, the texture will 
IS appear unnatural. 

|S Specifically, consider a case in which a three-dimensional shape, as shown for example in 

% Figure 17(A), is composed of rough polygons, and the three-dimensional shape resulting from 
S rotating this about axis of rotation Y is to be realized. Normal vector A at vertex a, which is the 
intersection point of sides 1 and 2 of polygon p that is part of the three-dimensional shape of Figure 
20 1 7(A), is a vector in an obliquely upward direction, which is a direction that is roughly 

perpendicular to polygon p. In this case, there is a large discrepancy between the frame line 
direction at vertex a and the direction of the orthogonal projection of line segment ab (side 1) tiiat 
joins this vertex a and another vertex b of polygon p onto the plane that is perpendicular to the 
normal vector at vertex a. That is, in this case, because normal vector A is a vector in an obliquely 
25 upward direction, the direction of the orthogonal projection of line segment ab (side 1) onto the 
plane that is perpendicular to the normal vector has a tilt with respect to the plane tiiat is 
perpendicular to axis of rotation Y. On the other hand, the frame line direction at vertex a is the 
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tangent direction, at vertex a, of the circle that is the locus of vertex a if polygon p is rotated about 

axis of rotation Y, so it is parallel to the plane that is perpendicular to axis of rotation Y. 

In this case, if fine splitting processing is done on polygon p, then the mteipolated line that 

interpolates between vertices a and b will be bent as shown in Figure 1 7(B), and it will be difficult 

5 to compose a smooth three-dimensional shape. 

Also, if there is no need to perform fine splitting processing on the polygons and make the 

three-dimensional shape that is composed by the subpolygons thus obtained into a specified shape 
and the above-mentioned bending of the interpolated line causes no problems, then it suffices to use 
only the normal vectors at the vertices as interpolation vectors. But if the above-mentioned bending 
10 of the interpolated line causes problems or if it is necessary to make the three-dimensional shape 
© composed by the subpolygons into a specified shape, then it may be impossible to realize the 
i specified shape by using only the normal vectors at the vertices as the interpolation vectors. 
Fy That is, if, for example, as shown in Figure 18, fine splitting processing is to be done on 

B quadrilateral polygon abdc, thereby composing circle 0, which is the base of a circular cylinder as 

1 f indicated by the dotted line in this diagram, then it will be necessary to split quadrilateral polygon 

S abdc into subpolygons so as to compose circle O, which will be the base of the circular cylinder. 

5 But mtWs case, denoting nomal vectors A through D at vertices a through d, respectively, vect^^ 

6 are given that are perpendicular to circle 0 that forms the base, so if fine splitting processing is 
done using such normal vectors A through D, quadrilateral polygon abdc will be spHt in a dnection 

20 parallel to side ab (cd) or side ac (bd). That is, splitting will not be done on the subpolygons that 
are to compose circle O. 

This is due to the same reason explained with Figure 17. Namely, in Figure 1 8, the 
direction of the orthogonal projection of the line segment that joins a vertex a with another vertex b 
onto the plane that is perpendicular to normal vector A at vertex a coincides with the direction of 

25 line segment ab. On the other hand, the curve along the three-dimensional shape to be realized that 
joins vertices a and b, that is, the frame line, is an arc ab that is part of circle O, and the tangent 
direction of this arc ab at vertex a, that is, the frame line direction, is the direction of the tangent of 
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circle 0 at vertex a. Therefore the direction of the orthogonal projection of line segment ab onto 
the plane that is perpendicular to normal vector A at vertex a of quadrilateral polygon abdc that 
composes the circular cylinder differs greatly from the frame line direction at vertex a, so 
quadrilateral polygon abdc is not ^lit into subpolygons so as to compose circle 0. That is, with 
5 fine splitting processing, the interpolated line that interpolates between vertices a and b is formed in 
such a way that it touches the orthogonal projection of line segment ab onto the plane that is 
perpendicular to normal vector A at vertex a and touches the orthogonal projection of line segment 
ab onto the plane that is perpendicular to normal vector B at vertex b, while the frame line, which is 
the curve that joins vertices a and b along the circular cylinder to be realized, is arc ab, so the 
1 0 interpolated line and the frame line are different, and quadrilateral polygon abdc is not split into 
O subpolygons so as to compose circle O (the circumference of the circle), which is the frame line 
41 (one only does splitting so that sides ab, cd, ac, bd are each taken without modification as an 
ry interpolated line). 

; 1 : 

C As interpolation vectors at a given vertex not only the normal vector at that vertex has been 

1 adopted but also a vector (the interpolated line direction vector) that expresses the direction (the 
ff! frame line direction) of the frame line that passes through that vector. If fine splitting processing is 
^ done vising the vector that expresses the frame line direction as an interpolation vector, the 
P interpolated line is formed in such a way that it coincides with the frame line (because this is 
something that constitutes an interpolated line such that the vector that expresses the frame line 
20 direction coincides with the frame line if it is used in the fme splitting processing), and the 
polygons are split into subpolygons to compose the three-dimensional shape to be realized. 

As vectors that express the frame line direction at a vertex, there are, for example, the 
tangent vector at the vertex (corresponding to the slope of a curve in a two-dimensional plane) and 
the normal vector of the frame line at the vertex (the definition of the normal vector of a firame line 
25 is discussed below), but here we adopt the normal vector of the frame line. 

If fine splitting processing is done using the normal vectors (the normal-direction vectors of 
the three-dimensional sh^e to be realized) at the vertices that are given for shading, the normal 
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vector faces the normal direction of the curved surface that is the three-dimensional shape to be 
realized, so the polygons are split into subpolygons so as to compose the curved surface that is the 
three-dimensional shape to be realized. That is, if fine spUtting processing is done using as 
interpolation vectors the normal vectors at the vertices that are given for shading, splitting into 
5 subpolygons is done so as, so to speak, to interpolate the curved surface that is the three- 
dimensional sh^e to be reahzed. Thus in the following, for convenience, these normal vectors are 
referred to as curved surface interpolation normal vectors. 

On the other hand, if fine spUtting processing of polygons is done using the normal vectors 
of the fi^e lines, then the sides that make up a polygon are spUt into subpolygons that have sides 
10 that, so to speak, interpolate the fame lines, that is, the curves (curves included in curved surfaces) 
1 that constitute the curved surface that is the three-dimensional shape to be realized. In following, 
for convenience, these normal vectors are referred to as frame line interpolation normal vectors. 

If for example the circular cylinder indicated by the dotted line in Figure 1 8 is composed 
with subpolygons obtained by fine splitting processing, the curved surface interpolation normal 
1 v' vectors at vertices a through d of quadrilateral polygon abdc are normal vectors A through D, 
m respectively, and the frame line interpolation normal vectors at vertices a through d are unit vectors 
5! in the direction of straight lines extending from the center of circle O toward vertices a through d. 

P If not just curve interpolation normal vectors but also frame line interpolation normal 

vectors are adopted as interpolation vectors, then frame line interpolation normal vectors are used 
20 when determining uiterpolated points (for example, mterpolated points P12, P23, P13. P24 in Figure 
15) that interpolate between adjacent vertices in the original polygon that is the object of fine 
splitting processing, and curved surface interpolation normal vectors are used when determining, so 
to speak, internal interpolated points in the original polygon (for example, interpolated point P,234 in 
Figure 15). 

25 If such fine splitting processing is done on, for example, quadrilateral polygon abdc in 

Figure 1 8, then frame line interpolation normal vectors are used as interpolation vectors for each of 
the intervals between vertices a and b, between vertices b and d, between vertices d and c, and 
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between vertices c and a, and interpolated points are determined as described above. As a result, 
interpolated points are formed on arcs ab, bd, dc, and ca. In the interior of quadrilateral polygon 
abdc, curved surface interpolation normal vectors axe used as interpolation vectoi^, and interpolated 
points are determined as described above. As a result, interpolated points are formed in the plane 
5 that includes circle 0. As a result, quadrilateral polygon abdc is split into subpolygons so as to 
constitute circle O. 

That is, if for example jSne splitting processing is done so as to generate four subpolygons 
by splitting quadrilateral polygon abdc into two parts in each of the directions of sides ab (cd) and 
ac (bd), then when, as shown in Figure 1 9(A), each of vertices a through d is given a frame line 
10 interpolation normal vector in the direction from the center of circle O toward vertex a through d, 

.J respectively, and each is given a curved surface interpolation normal vector in a direction 

^n- ■ 

%■ perpendicular to circle 0 (in Figure 19(A), in the direction flying out perpendicularly from the 

\ ^; surface of the diagram), then first, for the interval between vertices a and b or the interval between 

^'f vertices c and d, the frame line interpolation vectors are used as interpolation vectors, and arc ab or 

1 S cd, respectively, is determined as the interpolated line, and interpolated point e or f is set on the 

m respective interpolated line, as shown in Figure 19(B), Likewise for the interval between vertices a 

n\ ■ 

^0 and c or the interval between vertices b and d, the frame line interpolation vectors are used as 
y interpolation vectors, and arc ac or bd, respectively, is determined as the interpolated line, and 

interpolated point g or h is set on the respective interpolated line, as shown in Figure 1 9(C). 
20 Also, for example for the interval between interpolated points e and f (or the interval 

between interpolated points g and h), line segment ef is determined as an interpolated line using 
curve interpolation normal vectors as interpolation vectors, and interpolated point i is set on this 
interpolated line as shown in Figure 19(D). As a result, as shown in Figure 19(D), quadrilateral 
polygon abdc is split into quadrilateral polygons aeig, ebhi, hdfi, fcgi as four subpolygons to 
25 comprise circle 0. 

By the above-described fine splitting processing, a polygon is split into detailed (fine) 
polygons so as to give a smooth three-dimensional shape, so even if detailed data about the three- 
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dimensional shape to be realized is not given by data provision device 1 , a delicate three- 
dimensional shape can be composed and presented to the user just by giving rough data concerning 
the shape. Also, on the side of user terminal 4, a delicate three-dimensional shape can be 
reproduced from sparse data. 

Next, the processing of data provision device 1 of Figure 2 will be described. 

When input unit 1 1 is operated by the producer so as to compose a three-dimensional shape, 
splitting polygon data generation processing that generates the splitting polygon data used for fine 
splitting processing is performed by data provision device L 

Referring to the flowchart in Figure 20, we describe the splitting polygon data generation 
processing. 

In splitting polygon data generation processing, first, in step S 1 1, data processing unit 12 
decides whether the coordinates (coordinates in three-dimensional space) of the vertices of the 
polygons that comprise the three-dimensional shape and the normal vectors of the frame lines at the 
vertices (as stated below, these will be used as the fi^e line interpolation vectors) have been input 
from input unit 1 1 . 

In step S 1 1 , if it is decided that the coordinates of the vertices and the normal vectors of the 
frame lines at the vertices have not been input, one skips step S12 and proceeds to step S 13. 

If in step S 1 1 it is decided that the coordinates of the vertices and the normal vectors of the 
frame lines at the vertices have been input, that is, if the coordinates of the vertices and the normal 
vectors of the frame lines at the vertices have been input by the producer operating input unit 1 1 , 
then one proceeds to step SI 2, the coordinates of the vertices and the normal vectors of the frame 
lines at the vertices that have been input are temporarily stored in memory 12 A, and one proceeds 
tostepSn. 

In step SI 3, data processing unit 12 decides whether input unit 1 1 has been operated so as 
to confirm the stored content of memory 12A as splitting polygon data (hereafter called, for 
convenience, confirmation operation). If in step S 1 3 it is decided that confirmation operation has 
not been done by input unit 1 1, one returns to step SU and thereafter repeats the same processing. 
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If in step S 13 it is decided that coiifirmation operatic 
proceeds to SI 4, and data processing unit 12 reads the stored content of memory 12A and supplies 
it to, and stores it in, splitting database 13. Also, data processing unit 12 for example goes through 
the vertices in the order in which they were input and determines, based on the stored content of 
5 memory 12A, third-order Bezier curves in which the angle formed with the normal vector of the 
frame line at each vertex is 90 degrees, and supplies this, via splitting database 13, splitting 
processing unit 1 4, and rendering unit 1 5 , to display unit 1 6 and causes it to be displayed. 

In this way, as shown in Figure 2 1 , Bezier curves (indicated in the diagram by the dotted 
line) as the frame lines that constitute the three-dimensional shape are displayed on display unit 1 6. 
10 Thereafter, one proceeds to step S15, where data processing unit 12 decides whether input 

y unit 11 has been operated so as to add any input of coordinates of the vertices and normal vectors of 
'^J the frame lines at the vertices (hereafter called, for convenience, additional operation). If in step 
S15 it is decided that additional Operation has been done by input unit lU 

memory 12A is cleared, one returns to step S 1 1 , and thereafter, by repeating the processing of steps 
is" S 1 1 through SI 5, Bezier curves as the frame lines that constitute the three-dimensional shape are 

ffi drawn one after another. 

fli 

l^i That is, for example, as shown in Figure 22(A), the producer inputs the coordinates of 

fj. vertex Pi and normal vector (frame line interpolation normal vector) At of the frame line at this 

vertex Pi, as well as the coordinates of vertex P2 and normal vector A2 of the franie line at this 
20 vertex P,, and if confirmation operation is done by input unit 1 1 , data processing unit 12 determines 
Bezier curve P1P2 as a frame line that comprises the three-dimensional shape, and causes display 
unit 1 6 to display it. Also, the producer does additional operation on input unit 1 1 and, for 
example, as shown in Figure 22(A), inputs the coordinates of vertex P3 and normal vector A3 of the 
frame line at this vertex P3, as well as the coordinates of vertex P4 and normal vector A4 of the 
25 frame line at this vertex P4, and if confirmation operation is done on input unit 1 1 , data processing 
unit 12 determines Bezier curve P3P4 as a frame line that comprises the three-dimensional shape, 
and causes display unit 16 to display it. 
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Thereafter, the producer does additional operation on input unit 1 1 , and, for example, as 
shown in Figure 22(B), inputs the coordinates of vertex and normal vector (frame line 
interpolation nonnal vector) of the frame line at this vertex Pj, as well as the coordinates of 
vertex P3 and normal vector B3 of the frame line at this vertex P3, and if confirmation operation is 
5 done by input unit 1 1 , data processing unit 12 determines Bezier curve PiP3 as a frame line that 
comprises the three-dimensional shape, and causes display unit 16 to display it. Also, the producer 
does additional operation on input unit 1 1 and, for example, as shown in Figure 22(B), inputs the 
coordinates of vertex P2 and normal vector B2 of the frame line at this vertex Pj, as well as the 
coordinates of vertex P4 and nonnal vector B4 of the frame line at this vertex P4, and if confimiation 
1 0 operation is done on input unit 1 1 , data processing unit 1 2 determines Bezier curve P2P4 as a frame 
y line that comprises the three-dimensional shape, and causes display unit 16 to display it. 
§ Here, in Figures 22(A)-22(B) there are shown for example two vectors A| and B^ as normal 

hJ vectors of the frame line of vertex P^. However, vector A^ or B^ is perpendicular to curve P1P2 or 

■ w ■ 

1^ PiP3, respectively. Similarly, vector A2 or Bj is perpendicular to curve P1P2 or P2P4> vector A3 or B3 
1% is perpendicular to curve P1P3 or P3P4, and vector A4 or B4 is perpendicular to curve P3P4 or P3P4, 
f| respectively. 

Also, given two vertices P^ and P2 and nonnal vector A^ or A2 of the firanoe line at such 

■ 

vertex P, or P2, data processing unit 12 goes through these two vertices Pj and Pj and determines 
third-order Bezier curves, as frame lines comprising the three-dimensional shape, in which the 

20 angle formed with normal vector Aj or A2, respectively, is 90 degrees; this is determined, for 
example, in the following way. 

Namely, as shown in Figure 23, data processing unit 12 determines line segment P1T2*, 
which is the projection (orthogonal projection) of line segment P1P2 onto plane R, which includes 
vertex P^ and is perpendicular to normal vector A^. In the same way, data processing unit 12 

25 determines line segment P/T2" (not shown), which is the projection of line segment P1P2 onto the 
plane that includes vertex P2 and is perpendicular to normal vector A2. With the data processing 
unit 12, control points Qj and Q2 are determined, as explained in Figure 9, from the coordinates of 
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vertices P, and and from the angle formed by line segment PiP, and line segment P/P2' and the 

angle foimed by line segment P.Pz and line segment P,"?/, and the third-order Bezier curve 

specified by these control points Q, and Q2 as well as control point Pi and Pj is determined as a 

frame line that composes the three-dimensional shape. 
5 The Bezier cun^e as the frame line that is thus determined coincides with the interpolated 

line that is obtained if fine splitting processing is done by taking as interpolation vectors the normal 
vector of the frame line at vertex P, and the normal vector of the frame line at vertex Pj. 

Retummg to Figure 20, in step S15, if it is decided that input unit 11 was operated not with 
additional operation but so as to end the input of the coordinates of vertices and the normal vectors 
10 of the frame lines at the vertices, one proceeds to step S16, and with data processing unit 12 the 

0 curved surface formed by the frame lines determined thus & (the curved surface tha^ 

5 the three-dimensional shape) is detennined. That is, if, for example, frame lines P,P2, PjP4, P1P3. 
py P2P4 are determined as described in Figure 22, then in step S16 curved surface S is determined, 
£ which is surrounded by frame lines Y^?-,, P3P4, P1P3, P2P4 as shown in Figure 24. 

1 Then one proceeds to step S 17, and data processing unit 12 computes the firame line 

1 interpolation normal vector and curved surface interpolation normal vector for each vertex stored in 
W splitting database 13. That is, data processing unit 12 takes the normal vector of the frame line at 

6 each vertex stored in sphtting database 1 3, as is, as the frame line interpolation vector for each 
respective vector. Therefore the frame line interpolation normal vector at a given vertex (as well as 

20 the normal vector of the fi^e line at the vertex), from what was explained in Figure 23, becomes 
the normal-dfrection vector in the specified plane in the case where the Bezier curve as a frame line 
(the Bezier curve determined as explained in Figure 23) is touched by the line that is the projection 
of the line segment that joins the vertex and another vertex onto a specified plane that includes the 
vertex. 

25 Also, in step S17, data processing unit 12 determines the normal vectors of the curved 

surface determined m step S16 at each vertex stored in splitting database 13, sets them to tiie curved 
surface interpolation normal vectors at the correspondmg vertices, and supplies them to, and stores 
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them in, splitting database 13, The curved surface interpolation norraal vectors coincide with the 
normal vectors used in the case when shading of the polygons is done. 

Here, if in fine splitting processing the interpolated lines between vertices are determined 
using only the curved surface interpolation normal vectors among the fi:ame line interpolation 
5 normal vectors and curved surface interpolation nomial vectors, then, for example, as shown in 
Figure 25(A), the interpolated line will sometimes not coincide with the curved surface (frame line) 
determined in step S14 and will be bent. On the other hand, if the interpolated lines between 
vertices are determined using the frame line interpolation normal vectors, then, for example, as 
shown in Figure 25(B), a smooth interpolated line will be obtained that coincides with the curved 
1 0 surface (frame line) determined in step S 14. 

CI In step S 1 7, when data processing unit 12 deteraiines the frame line interpolation nonnal 

^0 vectors and curved surfece interpolation normal vectors, one proceeds to step S 1 8, and vector 
coalescence processing is done. 

That is, if there is a large discrepancy between the direction of the orthogonal projection of 
1 5 the line segment that joins one vertex with another vertex adjacent to it onto the plane that passes 

m through the one vertex and is perpendicular to the curved surface interpolation normal vector, and 

■ 'f^'i ■ 

^1; the direction of the tangent at the one vertex of the cxirved surface (frame line) along the three- 
^ dimensional shape to be realized (the frame line direction), then, as stated above, the interpolated 
line will be bent, and the size of this discrepancy is reflected in the difference between the frame 
20 line interpolation nonnal vector and the curved surface interpolation normal vector. 

On the other hand, the size of the aforesaid discrepancy is often zero (including cases in 
which it is almost zero) (where the size of the discrepancy is large is, for example, a case in which, 
as stated above, a circular cylinder or other body of revolution made by rotating a plane shape about 
an axis of rotation, or a similar three-dimensional shape, is to be realized); in this case, the frame 
25 line interpolation normal vector and the curved surface interpolation normal vector coincide 

(roughly coincide). It is redundant to separate the frame line interpolation normal vector and the 
curved surface interpolation normal vector that thus coincide and separately make them into 
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splitting polygon data. 

In order to reduce the volume of data in the splitting polygon data, in step S 1 8 the frame 
line interpolation normal vector and the curved surface interpolation normal vector at the same 
vertex are compared, and if they coincide (roughly coincide), then vector coalescence processing is 
5 done, iu which the frame line interpolation normal vector and the curved surfece interpolation 
nomal vector are combined into a single vector. Here, if the frame line interpolation normal vector 
and the curved surface interpolation normal vector coincide completely, then in step SI 8, for 
example, one or the other vector is selected, and this is made the result of the vector coalescence 
processing. And if the frame line interpolation normal vector and the curved surface interpolation 
1 0 normal vector coincide roughly, then in step S 1 8, for example, their average value is determined, 
Q and iMs is made the result of the vector coalescence processing. The result of the vector 
£ coalescence processing is written in instead of the frame line interpolation normal vector and the 
m curved surfece interpolation normal vector that are stored in splitting database 13 and are the object 
U ofthis vector coalescence processing. If the frame line interpolation normal vector and the curved 
1 F surface interpolation noraiai vector at tiie same vector do not coincide, tiiey are kept in tiie state in 
which they are stored in splitting database 13. 

Once data processing unit 12, in step SI 8, performs vector coalescence processing on all the 
vertices stored in splitting database 13, one proceeds to S19, in which the splitting polygon data is 
composed based on tiie content stored in splitting database 1 3, and splitting polygon data 

20 generation processing is terminated. 

Figure 26 shows the format of the splitting polygon data composed in step SI 9. 

Splitting polygon data consists of, for example, I reference data items #1 through #1, 
followed by I polygon data items #1 through #1 arranged in sequence, as shown in Figure 26(A). 
Here, polygon data item #i (i = 1, 2, I) is generated, for example in tiie splitting polygon 

25 data generation processing of Figure 20, every time a curved surface such as tiiat shown in Figure 
24 is made, for tiie quadrilateral polygons P,P2P4P3 that make up tiiis curved surface S. Therefore 
Figure 26(A) shows the splitting polygon data for the case in which a three-dimensional shape 
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consists of I polygons. 

As shown in Figure 26(B), polygon data item #i consists of the coordinates (pXi,py|,pZi), 
(p^jyPYi^P^^ (px3?py3^p23). of the vertices that constitute its polygon #i, the normal vectors 
(nxv,ny^,nzj, (xDi2Ay2y^i> (nx3,ny3^3) that are frame line interpolation normal vectors or curved 
surface interpolation normal vectors at each vertex, and other data. Attached to the vertex 
coordinates and normal vectors arranged in polygon data item #i are indexes for specifying them* 
And in the embodiment of Figure 26(B), sequential numbers are actually attached to the vertex 
coordinates and normal vectors as indexes, but for the indexes it is also possible to allocate 
sequential numbers to the vertex coordinates and normal vectors in the sequence in v^hich they are 
arranged, without writing the index into polygon data item #i. 

Reference data item #i, which is data that is used when polygon data item #i is referenced, 
consists for example of the number of vertices as the number of vertices that constitute polygon #i 
and reference data on each vertex, as shown in Figure 26(C). Therefore if polygon #i has J vertices, 
J reference data items concerning vertices will be laid out As shown in Figure 26(D), reference 
data on vertex #j (j = 1, 2, J) consists of the index of the coordinates of vertex #j, the indexes of 
frame line interpolation normal vectors A and B at the vertex, and the index of the curved surface 
interpolation normal vector at the vertex, arranged sequentially. 

If, for example, 1 is laid out as the index of the coordinates of vertex #j, then the coordinates 
(pxi,pyi,pzi) to which index "1" is assigned in polygon data item #i, which corresponds to reference 
data item #i, will be the coordinates of vertex #j. 

For example if, say, 1 is laid out as the index of frame line iiiterpolation normal vector A, 
then the normal vector (nxj,nyi,nzi) to which index "1" is assigned in polygon data item #i, which 
corresponds to reference data item #i, will be frame line interpolation normal vector A at vertex #j. 

And for example if, say, 2 is laid out as the index of frame line interpolation normal vector 
B, then the normal vector (nx2,ny2,nz2) which index "2" is assigned in polygon data item #i, 
which corresponds to reference data item #i, will be frame line interpolation normal vector B at 
vertex #j. 
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And for example if, say, 3 is laid out as the index of the curved surface interpolation normal 
vector, then the normal vector (nx3,ny3,nz3) to which index "3" is assigned in polygon data item #i, 
which corresponds to reference data item #i, mil be the curved surface interpolation normal vector 
at vertex #j. 

The reason why there are two frame Hne interpolation normal vectors, vectors A and B, at 
one vertex #j, is as follows. For example at each vertex through P4 of quadrilateral polygon 
P1P2P4P3 that comprises curved surface S shown in Figure 24, which are generated in the 
aforementioned splitting polygon data generation processing, two curves (frame lines) of different 
direction intersect, but the normal vectors for these two curves are given as curved surface 
interpolation normal vectors. 

In the foregoing case, frame line interpolation normal vectors A, B and the curved surface 
interpolation normal vector are each given a different index, but in a case where in step S 1 8 in 
Figure 20 frame line interpolation normal vectors A, B and the curved surface interpolation normal 
vector coincide and are coalesced into a single vector, each of the frame line interpolation normal 
vectors A, B and the curved surface interpolation normal vector is given an index allocated to their 
single coalesced vector. That is, if for example frame line interpolation normal vectors A, B and 
the curved surface interpolation noraial vector are each represented by (nXi,nyi,nZi), then the index 
of each of the frame line interpolation normal vectors A, B and of the curved surface interpolation 
normal vector is set to 1, which is the index allocated to normal vector (nxi,nyj,nzi) (in this case, 
normal vector (nxi,ny,,nz,) is the result of vector coalescence processing (in step S18 in Figure 20) 
on frame line interpolation normal vectors A, B and on the curved surface interpolation normal 
vector). Also, m this case, only vector {Tix^,ny^,nz{) is mapped to polygon data item #i as a normal 
vector. 

In the splitting polygon data generation processing in Figure 20, the producer causes the 
coordinates of the vertices and the normal vectors of the frame line at the vertices to be input, and 
then the three-dimensional shape is defined by determining the curves that will be the frame lines 
and causing the ciirves to intersect, but a three-dimensional shape can also be composed in the 
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following way. 

First, one takes actual measurements for the three-dimensional shape to be realized, 
determines the coordinates of each vertex in three-dimensional space and the normal vectors of the 
three-dimensional shape at each vertex, that is, determines the curved surface interpolation normal 

5 vectors, and has these input into data processing unit 12 by the producer. Data processing unit 12 is 
made to determine and display the curves that will be the frame lines, taking the curved 
interpolation normal vectors to be the frame line interpolation normal vectors A, B for each of the 
two frame lines that intersect at a given vertex. Then, for the displayed frame lines that are bent 
(distorted), one has the producer correct frame line interpolation normal vectors A, B that are equal 

10 to the curve interpolation nomial vector in such a way that the frame lines become smooth. In this 

0 case, one may dispense with the processing of steps S17 and S18 in Figure 20. 

S Next, splitting polygon data generation processing (Figure 20) is done by data provision 

J device 1 , and when splitting polygon data as shown in Figure 26 has been stored in splittmg 

U. database 1 3, the splitting polygon data is read from splitting database 1 3 in splitting processing unit 

15^ 14, and fine splitting processing is done. 

1 Referring to the flowchart in Figure 27, we describe the fine splitting processii^perfbrined 

^ if on polygons in splitting processii^ unit 1 4. 

i Here, for example a quadrilateral polygon P,P2P4P3 as shown in Figure 28 is split into M or 

N parts horizontaUy or vertically, respectively, thereby making something that is composed of MxN 

20 quadrilateral subpolygons (here, for example, the direction of line segment ?i?2 (or P3P4) of 

quadrilateral polygon PiP^PiPj in Figure 28 is taken as the horizontal direction, and the direction of 

line segment PjPj (or P2P4) is taken as the vertical direction). 

The curved surface interpolation vector at vertex Pi (i = 1, 2, 3, 4) of quadrilateral polygon 

P,P2P4P3 is denoted by rij, the line frame inteipolation normal vector for the horizontal firame line at 
25 vertex P; is denoted by A,, and the line frame interpolation normal vector for die vertical frame line 
is denoted by B,. 

In this case, in fine spUtting processing, first, in step S21, fine splitting processing of frame 
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line P1P2 is done. That is, in step S21, M-1 interpolated points are set between vertices Pj and 
Pj, and a curved surface interpolation normal vector ni2 is determined at each of these M-1 
interpolated points P(2. 

Then one proceeds to step S22, where splitting processing of frame line P3P4 is done. That 
5 is, in step S22, M-1 interpolated points P34 are set between vertices P3 and P4, and a curved surface 
interpolation normal vector n34 is determined at e^h of these M-1 interpolated points P34. 

Thereafter, one proceeds in sequence to steps S23 and S24, where splitting processing of 
frame line P1P3 and splitting processing of frame line P2P4 is done. That is, in step S23, N-1 
interpolated points P^j are set between vertex Pj and vertex P3, and a curved surface interpolation 
1 0 normal vector ni3 is determined at each of these N-1 interpolated points P13. And in step S24, N-1 
^ interpolated points P24 are set between vertex P2 and vertex P4, and a curved surface interpolation 
*J normal vector ^4 is determined at each of these N-1 interpolated points P24. 

Then one proceeds to step S25, where splitting processing inside the polygon of 
U quadrilateral polygon P1P2P4P3 is done. That is, in step S25, N-1 interpolated points are set between 
I S each of the M-1 interpolated points P12 and the corresponding one of the M-1 interpolated points 
m setting a total of (M-l)x(N-l) interpolated points Pi234, and a curved surface interpolation 

% normal vector n^izA is determined at each of these (M-l)x(N-l) interpolated points Pi234- 
5t Thereafter, one proceeds to step S26, where quadrilateral polygon P1P2P4P3 is split into 

MxN quadrilateral subpolygons based on the iirterpolated points Pi2> P34, Pi3, P24? and Pj^^^ 
20 determined in steps S21 through S25, and fine splitting processing is terminated. 

For example, assurning now that quadrilateral polygon P1P2P4P3 shown in Figure 28 is split 
into 2x2 quadrilateral subpolygons (and therefore M-1=N-1=1), in step S21 of Figure 27, an 
interpolated line that coincides with frame line P1P2 is determined by performing the control point 
computation processing of Figure 9 using the coordinates of vertices Pj and P2 and the frame line 
25 interpolation normal vectors Aj and Aj. And in step S21, interpolated point P^j, which is one point 
on interpolated line P1P2, is determined as shown in Figure 29, by substituting for example 0.5 for 
the parameter t in equation (1) of the Bezier curve that represents this interpolated line P1P2. Also, 
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in step S21, curved surface interpolation normal vector nj2 at interpolated point Pjj is determined 
from curved surface interpolation normal vector or n2 at vertex or Pj, respectively, as 
explained in Figure 16. 

Likewise in step S22, the same processing as in step S2 1 is done on vertices P3 and P4, 
thereby determining interpolated point P34, which is one point on interpolated line P3P4, and 
determining curved surface interpolation normal vector n34 at this interpolated point P34, as shown 
in Figure 29. 

In step S23, an interpolated line that coincides with frame line PjPj is determined by 
performing the control point computation processing of Figiire 9 using the coordinates of vertices 
Pj and P3 and the frame line interpolation normal vectors and B3, In step S23, interpolated point 
Pi3, which is one point on interpolated line P1P3, is determined as shown in Figure 30, by 
substituting for example 0.5 for the parameter t in equation (1) of the Bezier curve that represents 
this interpolated line P1P3. Also, in step S23, curved surface interpolation normal vector n^^ at 
interpolated point Pi3 is determined from curved surface interpolation normal vector or at 
vertex Pj or P3, respectively, as explained in Figure 16. 

Likewise in step S24, the same processing as in step S23 is done on vertices Pj and P4, 
thereby determining interpolated point P24, which is one point on interpolated line P2P4, and 
determining curved surface interpolation normal vector n24 at this interpolated point P24, as shown 
in Figure 30. 

In step S25, interpolated lines are determined that interpolate between corresponding 
interpolation members of the interpolated points on interpolated line F^Pj and the interpolated 
points on interpolated line P3P4, and on such an interpolated line, the same number of interpolated 
points are set as the interpolated points set on interpolated line PjPj (or interpolated line P2P4). That 
is, in the present case, as shown in Figure 3 1 , interpolated line which interpolates between 
interpolated points P32 and P34, is determined by performing the control point computation 
processing of Figure 9 using the coordinates of interpolated points P12 and P34 and the curved 
surface interpolation normal vectors n^j, n34. The interpolated point P1234, which is one point on 
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interpolated line P12P34, is determined as shown in Figure 3 1 , by substituting for example 0.5 for the 
parameter t in equation (1) of the Bezier curve that represents this interpolated line P12P34. Also, 
curved surface interpolation normal vector ni234 at interpolated point P,2j4 is determined from curved 
surface interpolation normal vector n,2 or n34 at interpolated point P12 or P34, respectively, as 

5 explained in Figure 1 6. 

In step S26, quadrilateral polygon P,P2P4P3 is split into 2x2 quadrilateral subpolygons based 
on the interpolated points P,2, P34, Pu, P24, and P,234 determined in steps S21 through S25. That is, 
quadrilateral polygon P1P2P4P3 shown in Figure 28 is split into four quadrilateral subpolygons 
P.P>2Pt234P,3, P12P2P24P1234. P1B4P24P4P34, and P,3P,234P34P3, thereby realizing a to^^ 

1 0 shape that is smoother than in the case of just quadrilateral polygon P1P2P4P3- 

0 In the above case, in step S25, interpolated lines are determined that interpolate between 
Ci corresponding interpolation members of the interpolated points on interpolated Une P,P2 and the 
li interpolated points on interpolated line P3P4, and on such an interpolated line, the same number of 
Z interpolated points are set as the interpolated points set on interpolated line P,P3 (or interpolated 

15 *' line P2P4), but otherwise it suffices to determine interpolated lines that interpolate between 

1 corresponding interpolation members of the interpolated points on interpolated line P1P3 and the 
W interpolated points on interpolated line P2P4, and on such an mterpolated hne, the same number of 
p interpolated points are set as the interpolated points set on interpolated line PjPj (or interpolated 

linePjPJ. 

20 That is, if for example quadrilateral polygon P,P2P4P3 shown in Figure 28 is to be split into 

2x2 quadrilateral subpolygons, in step S25, as shown in Figure 33, interpolated line P,3P24 that 

interpolates between interpolated points P.j and P24 is determined by performing the control point 
computation processing of Figure 9 using the coordinates of interpolated points P,3 and P24 and the 
curved surface interpolation normal vectors n,3 and n24. In step S25, interpolated point P,324, which 
25 is one point on interpolated line P,2P34, is determined by substituting for example 0.5 for the 
parameter t in equation (1) of the Bezier curve that represents this interpolated line P,3P24, and 
curved surface interpolation normal vector n,324 at interpolated point P,324 is determined from curved 
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surface interpolation normal vector n,3 or n24 at interpolated point P,3 or P24, respectively, as 
explained in Figure 16. 

In this case, quadrilateral polygon P,P2P4P3 in Figure 28 is spUt into four quadrilateral 

SUbpOlygOnS ?xf 12^x32*^ \i> P12P2P24P1324J P1324P 24P4P34> aildPi3Pi324P34P3- 

5 Here it is possible in step S25 to determine both interpolated points P,234 (Figure 31) and 

Pi324 (Figure 33) and set the final interpolated point to the point that is expressed by, say, the 
average value of their coordinates. In this case, the curved surfece interpolation normal vector at 
the final interpolated point is set to, say, the average value of curved surface interpolation normal 
vectors ni234 and n,324. 

10 The subpolygons obtained by the above fine splitting processing are supplied firom splitting 

CI processing unit 14 to rendering unit 15 and are drawn by rendering processing being performed. 
That is, rendering unit 1 5 for example performs rendering on the subpolygons and converts them to 
the screen coordinate system. The shading of the subpolygons is done using the curved surface 
interpolation normal vector at each vertex. Rendering unit 15 determines the final RGB values of 
10 each pixel that constitutes display unit 16, such as by calculating the texture addresses for texture 
mapping using the texture data stored in texture database 17, and outputs them to display unit 16. 
In this way, the three-dimensional image consisting of the subpolygons is displayed on display unit 
B 16. ; 

And if there are no problems in the three-dimensional image displayed on display unit 16, 
20 the producer operates input unit 1 1 so as to supply the stored content of splitting database 13 to 
transmission/recording device 1 8. In response to this, the splitting polygon data stored in splitting 
database 1 3 is supplied to transmission/recording device 18. When it receives the splitting polygon 
data, transmission/recording device 18 reads the texture data from texture database 17, multiplexes 
it with the splitting polygon data, and transmits it via transmission medium 2 or records it on 
25 recording medium 3. 

If there is any problem with the three-dimensional image displayed on display unit 1 6, the 
producer corrects the splitting polygon data by operating input unit 1 1 . 
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Next, referring to the flowchart in Figure 34, we further describe the frame line splitting 
processing in steps S21 through S24 in Figure 27. Here one vertex that constitutes the polygon is 
denoted by Pj, and another vertex that is adjacent to this vertex Pj is denoted by Pj. Also, the frame 
line interpolation vector at vertex Pj or P^ for frame line P1P2 between vertices P^ and P2 is denoted 
5 by Aj or A2, respectively, aad the curved surface interpolation normal vector at vertex P^ or P2 is 
denoted by n^ or n2, respectively. 

In frame line splitting processing, first, in step S3 1, straight line (line segment) ?^P2 is 
determined, one proceeds to step S32, straight line PjP2 is orthogonally projected onto the plane that 
includes vertex Pi or P2 and is perpendicular to frame Ime interpolation normal vector Aj or Aj, 
10 respectively, the unit vector in the straight-line direction projected onto each plane is determined, 

y and each is taken as the tangent vector at vertex Pj or P2, respectively. 

hi 'I 

'^1 One then proceeds to step S33, which determines the angle 9^ or 02 that straight line PjPj 

rtJ forms with the tangent vector at vertex Pj or P2, respectively. Then one proceeds in sequence to 
H steps S34 and S3 5, where a third-order Bezier curve is determined as the interpolation line that 
1 5^ coincides with frame line P^Pj, as in the case in Figure 9. 
m That is, in step S34, based on angles 9, and 62 and the coordinates of vertices Pj and P2, one 

^1 determines control edge length or L2, which is the distance from control point Pj or P2 to another 
y control point Qj or Q2, respectively. And m step S35, control point or Q2 is determined from 
control edge length Lj or Lj, respectively, and thereby a three-dimensional Bezier curve is specified 
20 as the interpolated line that coincides with frame line PiPj. 

Proceeding in sequence to steps S36 and S37, interpolated points P12 are set on interpolated 
line P1P2, which is a Bezier curve, curved surface interpolation normal vectors n^2 these 
interpolated points P12 are determined, and frame line splitting processing is terminated. 

That is, in step 836, an interpolated point P^j is determined by substituting a specified value 
25 into parameter t in equation (1) that expresses interpolated line P1P2, which is a Bezier curve. And 
in step S36, tangent vector S12 at interpolated point P12 of interpolated line P1P2 is determined as 
explained in Figure 16, and vector nntj described in Figure 16 is determined by doing linear 
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interpolation using curved sxirface interpolation normal vectors n, and nj. And in step S37, vector 
nn,2 is corrected by tangent vector S12 as explained in Figure 16, and the result of the correction is 
determined as final curved surface interpolation normal vector n,2 at interpolated point P,2. 

Next, referring to the flowchart in Figure 35, we fiirther describe the splitting processing 
inside polygons in step S25 of Figure 27. Here, one interpolated point on the frame line obtained 
by frame line splitting processing is denoted by P„ and the interpolated point on the frame line that 
is opposite this frame line and corresponds to interpolated point P, is denoted by Pj. Also, in the 
frame line splitting processing for determining interpolated point P, or P^, the curved surface 
interpolation normal vector determined together with interpolated points P, and Pj is denoted by n, 
or 1X2, respectively. 

In splitting processing of the interior of polygons, the same processing is done in steps 41 
through S47 as in the case of steps S3 1 through S37 in Figure 34 -except that in step S42 tiie 
tangent vector at interpolated point Pj or Pj is determined usii^ not the frame line interpolation 
normal vector but curved surface interpolation vector n, or nj, respectively - and the interpolated 
points on tiie Bezier curve as the mterpolated line that interpolates between interpolated points P, 
and P2, and curved surface interpolation normal vector n,2 at these interpolated points are 
determined. 

If, as above, a vertex has both a frame line interpolation normal vector and a curved surface 
interpolation normal vector, then an interpolated point that interpolates between vertices of the 
ori^al polygon on which fine splitting processing is done is determined using the frame line 
interpolation normal vectors, and an interpolated point that interpolates between interpolated points 
is determined using the curved surfece interpolation normal vectors. But if the bending of the 
interpolated line (frame line) as stated above is not a problem, then an interpolated point may be 
determined using only the curved surface interpolation normal vectors, even if the vertices have 
both frame line interpolation normal vectors and curved surface interpolation normal vectors. 

With the aforesaid fme splitting processing, subpolygons that constitute a smooth three- 
dimensional shape can be generated from splitting polygon data concerning rough polygons. 
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That is, for example the cube shown in Figure 36 consists of six quadrilateral (square) 
polygons constituting its six faces, and if drawing is done without performing any fine splitting 
processing on these six quadrilateral polygons, what results is, for example, a cube as shown in 
Figure 37. In contrast to this, if each vertex of the six quadrilateral polygons is given as an 
5 interpolation vector (curved surface interpolation normal vector) a vector that extends radially from 
the center of the cube, and fine splitting processing is carried out, then what results is, for example, 
a sphere as shown in Figure 38. In Figure 38 (as in Figure 40 through Figure 42, which are 
discussed below), each quadrilateral polygon is split into 5x5 subpolygons. 

Furthermore, by changing the interpolation vectors given at each vertex of the six 

10 quadrilateral polygons from those shown in Figure 36 to, for example, ones that are tilted as shown 
0 in the side view in Figure 39, the six quadrilateral polygons, by fine spUtting processing, are split 

3 into subpolygons tiiat comprise a distorted sphere as indicated by the dotted line in this diagram. 

■ M 

m That is, by just changing the interpolation vectors assigned to the six quadrilateral polygons that 

S constitute the cube, one can obtain a, so to speak, egg-shaped three-dimensional shape as shoAwn in 

1 Sf" Figure 40 or Figure 41 . 
^ Here the three-dimensional shapes shown in Figure 3 8, Figure 40, and Figure 4 1 can be 

^ realized by using as interpolation vectors only the curved surface interpolation normal vectors. 

#- 

O Also, for example, a circular cylinder as shown in Figure 42 can be realized through fme 

splitting processing by assigning to the vertices of those of the six quadrilateral polygons 

20 comprising the cube shown in Figure 36 that will constitute the side faces of the circular cylinder 
the normal vectors of these quadrilateral polygons as frame line interpolation normal vectors or 
curved surface interpolation normal vectors, assigning to the vertices of the quadrilateral polygons 
that will comprise the circle that is to be the base of the circular cylinder, as frame line interpolation 
normal vectors, normal vectors in a direction extending radially from the center of this circle, and 

25 assigning normal-direction vectors of (the surface of) this circle as curved surface interpolation 
normal vectors. 

Since, as described above, fme splitting processing makes it possible to generate 
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subpolygons that constitute a smooth three-dimensional shape from splitting polygon data 
concerning rough polygons, the producer is given tiie ability to compose a complex three- 
dimensional shape even without setting detailed parameters concerning the three-dimensional 
shape. 

5 Next, referring to the flowchart in Figure 43, the processing of user terniin 

will be described. 

With user tenninai 4, reception/playback device 2 1 receives data transmitted via 
transmission medium 2 or plays back data recorded on recording medium 3 , acid among this data, 
the splitting polygon data is supplied to and recorded in splitting database 22, and the texture data is 
10 supplied to and recorded in texture database 27. 

0 The splitting polygon data recorded in splitting database 22 is read, for example in one- 

1 frame units, by geometry processing unit 23, and in step S51 of Fig. 43, geometry processing unit 
5 23 performs geometry processing (such as coordinate transformations according to the viewpoint) 

2 on this splitting polygon data in response to operation by the user of input unit 28, and supplies the 
1 f result to splitting processing unit 24. In step S52, splitting processing unit 24 performs fine 

2 splitting processing on the splittit^ polygon data in the same way as in splitting processing unit 14 
W of data provision device 1, and the resulting subpolygons are supplied to rendering unit 25. In step 
P S53, rendering unit 25 performs a perspective transformation (perspective projection 

transformation) on the subpolygons from splitting processing unit 14, and proceeds to step S54. In 
20 step S54, brightness calculation (shading (for example, Gouraud shading or Phong shading)) is 

done on the transformed data, and texture address calculation, etc. is done, thereby determining the 
RGB values of each pbcel. In step S55, in rendering unit 25 the RGB values of each pixel are 
written to a frame buffer that is not shown in the diagram, and one rettoms to step S5 1 to wait for 
splitting polygon data concerning the next fi^me to be read from splitting database 22. Thetiiree- 
25 dimensional image as RGB values written into the frame buffer is read out with the prescribed 
timing and is displayed on display unit 26. 

Therefore, with user terminal 4 too, as in tiie case of data provision device 1 , subpolygons 
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that constitute a smooth three-dimensional shape can be generated from splitting polygon data 

concerning rough polygons. 

Next, Figure 44 shows an example of the coiifiguration if user teim^ 

game machine. And if user teraiinal 4 is a video game machine, in addition to data for displaying 
5 three-dimensionaiimages,gameprograms(computerprogramsX etc. are also provided to 
terminal 4 from data provision device 1 via transmission medium 2 or recording mediim 3. 

This video game machine has two kinds of buses for exchanging data among the blocks, 
mam bus 101 and sub bus 102; main bus 101 and sub bus 102 are connected via bus controller 1 16. 
Connected to main bus 101, besides bus controller 1 16, are, for example, main CPU (central 
10 processing unit) 111, which consists of subprocessors, etc., main memory 1 12, which for example 

0 consists of RAM (random access memory), main DMAC (direct memory access controller) 1 13, 

1 MDEC (MPEG (Moving Picture Experts Group) decoder) MD 
processor unit) 115. 

W Coniiectedto sub bus 102, besides bus controller 116, are GPU 115, sub CPU 121, 

ISH for exarnple is configured in tte same way as main CPU 111, sub memory 122, which for example 
0 is configured in the same way as main memory 1 12, sub DMAC 123, ROM (read only memory) 
tj 124, which holds the operating system, etc., SPU (sound processing unit) 125, ATM (asynchronous 
Z transmission mode) communication unit 126, auxiliary memory unit 127, and input device interface 
J* I/F128. 

20 Here, data is exchanged at high speed by main bus 101 and at low speed by sub bxis 102. 

That is, the high-speed performance of main bus 1 0 1 is assured by using sub bus 1 02 for data that 
can be exchanged at low speed. 

Bus controller 1 1 6 is made so as to disconnect main bus 1 0 1 and sub bus 1 02 and connect 
main bus 101 and sub bus 102. If main bus 101 and sub bus 102 are disconnected, only devices 

25 connected to main bus 1 0 1 can be accessed firom main bus 1 0 1 , and only devices connected to sub 
bus 102 can be accessed fix>m sub bus 102, but if sub bus 102 is connected to main main bus 101, 
any device can be accessed from either main bus 1 0 1 or sub bus 1 02. And in the initial state, such 
as immediately after the power to the device has been turned on, bus controller 1 1 6 is in open state 
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(the state in which main bus 1 0 1 and sub bus 1 02 are connected). 

Main CPU 1 1 1 performs various processing in accordance with programs stored in main 
memory 1 12. That is, main CPU 1 1 1 , for example when the device is activated, reads via bus 
controller 1 16 the booting program from ROM 124 (connected to sub bus 102), which is on sub bus 
102, and executes it. In this way, main CPU 1 1 1 causes the application programs (here, the game 
programs and programs for performing the aforementioned fine splitting processing, etc.) and 
necessary data to be loaded from auxiliary memory device 127 into main memory 1 12 and sub 
memory 122. Then main CPU 1 1 1 executes the programs it has thus caused to be loaded into main 
memory 112. 

Main CPU 1 1 1 includes a built-in GTE (Geometry Transfer Engine) 1 17; this GTE 1 17 has 
for example a parallel operation mechanism which executes multiple operations in parallel, and in 
accordance with requests from main CPU 1 1 1 performs high-speed arithmetic processing for such 
geometry processing as coordinate system transformations, etc. Thus, by carrying out processmg 
(geometry processing) in accordance with requests from main CPU 111, GTE 1 17 generates and 
supplies to main CPU 1 1 1 the data for the polygons that constitute the three-dimensional image to 
be displayed. When main CPU 1 1 1 receives the polygon data from GTE 1 17, it transfers it to GPU 
115 via main bus 101, 

Main CPU 1 1 1 also includes a built-in cache memory 1 19; processing can be speeded up by 
accessing this cache memory 119 instead of accessing main memory 1 12. 

As described above, main memory 1 12, besides storing programs, also stores data, etc. that 
is necessary for processing by main CPU 111. Main DMAC 1 1 3 controls DMA transfers to 
devices on main bus 101 . However, when bus controller 116 is in open state, main DMAC 113 
also controls devices on sub bus 102. MDEC 1 14, which is an I/O device that can operate in 
parallel with main CPU 111, functions as an image expansion engine. That is, MDEC 114 decodes 
image data which was compressed by MPEG encoding. 

GPU 115 functions as a rendering processor. That is, GPU 115 receives data, including 
splitting polygon data, transmitted from main CPU 1 1 1 and splits it into subpolygons by 
performmg fine splitting processing. Also GPU 115, by performing perspective projection 
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transformations on the subpolygons, converts it to data in a two-dimensional plane (screen 
coordinate system), and computes and writes (draws) to graphic memory 1 1 8 the pixel data that 
constitutes the polygons based on, for example, color data for the vertices of the polygons (although 
not stated above, color data is also included in the splitting polygon data) and Z values that mdicate 

5 their depth (depth from the viewpoint). Also, GPU 1 1 5 reads out the pixel data that has been 
written into graphic memory 1 18 and outputs it as a video signal. In addition, GPU 115, as 
necessary, receives splitting polygon data also from main DMAC 1 1 3 or devices on sub bus 1 02 
and perforais similar processing in accordance with the data. 

Graphic memory 118 consists o^ for example, DRAM, and has frame memory 141, Z 

10 buffer 142, and texture memory 143, as shown in Figure 45. Frame memory 141 stores the pixel 
data to be displayed on the screen, for example the portion for one frame. Z buffer 142 stores the Z 
i value of the polygon that is nearest to the viewer in the image to be displayed on screen; it has 

3i enough memory capacity to store, for example, the Z values for one frame. Texture memory 143 

ftl 

hi stores data on the texture to be attached to the polygons. 
1 Si GPU 1 1 5 performs processing using frame memory 1 41 , Z buffer 142, and texture memory 

1 43 . That is, GPU 1 1 5 causes the Z value of the subpolygon constituting the three-dimensional 
Ki image that is nearest to the viewer to be stored, and based on the values stored in this Z buffer 1 42, 

ft I 

1 it is decided whether to draw the pixel data (RGB values) to frame buffer 141. If the pixel data is to 
y. be drawn, texture data is read from texture memory 143, and this data is used to determine the pixel 
20 data to be drawn, and drawiag is done to frame memory 141. 

Returning to Figure 44, sub CPU 1 2 1 performs various processing by reading and executing 
programs stored in sub memory 122. Stored in sub memory 122, as in main memory 1 12, are 
programs and the reqmred data. Sub DMAC 123 controls DMA transfers to devices on sub bus 
102. Also, sub DMAC 123 acquires bus rights only when bus controller 1 16 is in closed state 
25 (when main bus 101 and sub bus 102 are disconnected). ROM 124, as described above, stores the 
booting program and the operating system, etc. Also stored in ROM 124 are programs for both 
main CPU 1 1 1 and sub CPU 121 . ROM 124 here has a slow access speed, and therefore it is on 
sub bus 102. 
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SPU 125 receives packets transmitted from sub CPU 121 or sub DMAC 123 and reads 
audio data from sound memory 129 according to the sound commands laid out in these packets- 
Then SPU 125 outputs the read-out audio data to a speaker not shown. ATM conraiunication unit 
126 performs control (ATM communication control) of the communication that is done via, for 
5 example, transmission medium 2. In this way a video game machine user can compete with other 
video game machine users by exchanging data either directly or via data provision device 1 , a 
server on the Intemet, or a so-called personal computer communications center. 

Auxiliary memory device 127 plays back information (programs, data) stored on recording 
medium 3 by, for example, a disk drive. Input device interface 128 consists of control pad 128A 
10 for giving various input and interface, and 128B or 128C, etc, for receiving external input such as 
im^es or audio played pack by other devices; it outputs to sub bus 102 signals that respond to 
J input from outside. Sound memory 129 stores audio data. 

^ In user terminal 4 in Figure 3, reception/playback device 21 corresponds to ATM 

rtj communication unit 126 and auxiliary memory device 127 of Figure 44, splitting database 22 
1S3 corresponds to main memory 1 12 of Figure 44, geometry processing unit 23 corresponds to GTE 
^ 1 1 7 in Figure 44, splitting processing unit 24 and rendering unit 25 correspond to GPU 1 1 5 in 
i! Figure 44, texture database 27 corresponds to texture memory 143 in Figure 45, and input unit 28 
W corresponds to control pad 128 A in Figure 44. 

O In a game machine configured as described above, when the power to the device is turned 

25^ on, by the booting program being read from ROM 124 and executed in main CPU 111, programs 
and data are read by ATM communication unit 126 via transmission medium 2, or programs and 
data are read by auxiliary memory device 127 via recording medium 3, and are expanded into main 
memory 1 12 and sub memory 122. In main CPU 1 1 1 or sub CPU 121, respectively, the program 
expanded into main memory 1 12 or sub memory 122 is executed, thereby playing back the game 
25 images (here assumed to be moving images) and sound. 

That is, for example, in main CPU 1 1 1 geometry processing is done on the splitting 
polygon data stored in main memory 1 12, and is supplied to GPU 1 15 via main bus 101 . 
Upon receiving splitting polygon data from main CPU 111, GPU 1 1 5 splits it into 
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subpolygons by performing fine splitting processing. GPU 1 1 5 also performs a perspective 
transformation on the subpolygons, and draws the transformed subpolygons to frame memory 141 
using Z buffer 142. The results of drawing to frame memory 141 are appropriately read in GPU 
1 15 and output as a video signal. In this way, three-dimensional images for the game are displayed 
on, for example, display unit 26 (Figure 3) as a two-dimensional output device. 

Meanwhile, in sub CPU 121, sound commands that direct the generation of audio are 
generated in accordance with the data stored in sub memory 122. These sound conomands are 
packetized and supplied to SPU 125 via sub bus 102. SPU 125 reads audio data from sound 
memory 129 and outputs it in accordance with the sound commands from sub CPU 121 . In this 
way, background music for the game and other sounds are output. 

As described above, interpolated lines that interpolate between one vertex and another are 
detennined from the coordinates of the vertices of a polygon and interpolation vectors at the 
vertices, and mterpolated points on the interpolated Imes are determined as vertices of subpolygons, 
so it is possible to realize a smooth three-dimensional shape just by given data on polygons that are 

to some extent rough. 

Since a smooth three-dimensional shape can be realized with data concerning rough 
polygons, that is, witii a small amount of data, data can be efficientiy stored and transmitted if 
three-dimensional images are to be provided on, for example, the World Wide Web (WWW), 
which has been constructed on die Internet. That is, the splitting polygon data can be provided to 
user terminal 4 using a relatively small-capacity transmission medium 2 or recording medium 3 . 

From die standpoint of processing efficiency in, for example, video game machines or other 
graphic systems in which real-time display of three-dimensional images is important, the 
processing of polygons can be minimized by finely displaying three-dimensional shapes that are 
near to die viewpomt and coarsely displaying three-dimensional shapes that are far from die 
viewpoint When doing so, die level offineness (coarseness) ofdietiiree-dimensional shape, 
indicating how finely (or coarsely) die tiiree-dimensional shape is to be made, is known as its level 
of detail (LOD), and diree-dimensional shapes of die appropriate fmeness (coarseness) can be 
displayed by determinmg according to die level of detail die number of partitionings of polygons 
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when fine splitting processing is to be done. 

If a three-dimensional shape composed of polygons is to be enlarged, the coarsening of the 
three-dimensional shape due to its enlargement can be prevented by doing fine partitioning and 
splitting the polygons into a number of subpolygons that depends on the enlargement ratio. That is, 
5 in this case, a three-dimensional shape of fixed smoothness can be presented regardless of the 
enlargement ratio. 

Also, because the splitting polygon data obtained by sphtting polygon data generation 
processing includes the coordinates of the vertices of the polygons and the normal vectors at each 
polygon that are conventionally used for display of three-dimensional images (the curved surface 
10 interpolation noraial vector conventionally coincides with the normal vector assigned to a vertex), 
13 this data can be handled even on an existing low-speed video game machine or other graphics 
^ system, and three-dimensional shapes can be displayed, althoi^h they will be coarse. 
a Since the quantity of splitting polygon data is small, the amount of calculation in geometry 

W processing and the like can be kept small by making sure that geometry processing for deformation 
1 5fl or rotation of a three-dimensional shape, as well as the processing up to just before division by the 
g Z value for perspective transforaiation (perspective division), are done prior to doing fine splitting 
S processing, and by carrying out division by the Z value for perspective transformation on the 
]j subpolygons that are obtained after fine splitting processmg. 

W Also, in this embodiment it is considered ideal for an interpolated line to be equal to ti^^ 

20 of a circle or ellipse that passes through the two points interpolated by the interpolated line, and 
because such interpolated lines are determined, polygons that constitute a sphere, body of 
revolution, or similar shape can be represented with a smaller quantity of data tiian, for example, 
the case in which a sphere, body of revolution, or similar shape is represented by spline curves or 
Bezier curves. 

25 The foregoing discussion concerns data provision systems or video game machines to 

which this invention applies, but this invention also is applicable to devices that perform computer 
graphics processing, such as effectors that give special effects to images, or CAD. Moreover, this 
invention is also applicable to, for example, a recording and playback device or transmission device 
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that encodes natural im^es taken with a video camera and records and plays back or transmits and 
receives. That is, splitting polygon data generation processing can be applied to encoding 
processing so as to represent with polygons a natural image taken by a video camera or similar 
device, and fine splitting processing can be applied to decoding processing in which splitting 
polygon data obtained by such encoding is decoded into the original natural image. 

This invention is applicable to drawing either moving images or still images. 

This embodiment deals with three-dimensional graphics, but this invention is also 
applicable to, for example, two-dimensional graphics as well. That is, the present invention makes 
it easy to draw circles and ellipses just by prescribing, for example, a few points (at least two) by 
which an arc of a circle or ellipse can be formed, along with interpolation vectors at these points. 
Since the curvature of curves obtained in this way varies smoothly as is evident from Figure 10 
through Figure 13, it is possible to obtain curves that vary smoothly. 

The number of partitions of polygons by fine splitting processing, besides being determined 

according to the level of detail or the enlargement ratio as discussed above, can be determined, for 

example, according to the processiag capacity of the hardware that performs the fine splitting 

processing, or randomly using a random number. If the number of partitions of polygons is 

determined according to the processing capacity of the hardware that performs the fine splitting 

processing, one can display a three-dimensional shape of a smoothness appropriate to its processing 

capacity. If the number of partitions of polygons is determined randomly, the pattem that appears 

on the surface of a three-dimensional shape (the pattem composed by the boundary lines between 

polygons) can be varied randomly. 

Also, in this embodiment it is considered ideal for an interpolated line to be eqiial to the arc 

of a circle or ellipse that passes through the two points interpolated by the interpolated line, but an 

interpolated line is not limited to this. That is, an interpolated line may be determined so as to 

minimize the square error with the curve, (frame line) along the three-dimensional shape to be 

realized, that passes through the two points that the interpolated line interpolates between. 

In this embodiment, cos 9' is approximated as shown in equation (1 0), but cos 0' may also 

be determined accurately, without performing such an approximation. Also, in this embodiment 
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the deteraiination is made by calcxilating the control edge length ratios L,/K and L2/K of the third- 
order Bezier curve from and 02, but in order to speed up this calculation, one may first prepare a 
correspondence table that discretizes from (9|, to (L^/K, L^/K), and determine L^/K, Lj/K xising 
this correspondence table, 
5 Also, this embodiment adopts third-order Bezier curves as interpolated lines, but the 

interpolated lines may be Bezier curves of order other than three, or parametric curves other than 
Bezier curves. 

If the three-dimensional shape composed by subpolygons obtained by fine splitting 
processing is allowed to be an arbitrary shape, then it suffices to have only curved surface 
1 0 interpolation normal vectors as the interpolation vectors, with no need for frame line interpolation 
normal vectors. 

^1 Also, this embodiment adopts normal vectors of franie lines as vectors that ex^ 

% direction of the frame line at a vertex, but as vectors that express the direction of the frame line at a 
'J"; vertex one may also adopt tangent vectors of the frame line, as stated above. But because this 
I S^f tangent vector differs in its orientation by just 90 degrees from the normal vector of the firame line, 
^ it often differs from the curved surface interpolation normal vector as well, so in step S 1 8 in Figure 
m 20 they will often not be coalesced into a single vector, thus increasing the quantity of data in the 
% splitting polygon data. 

P A computer program for performing the above-described fine splitting processing can be 

20 provided, along with the splitting polygon data, to user terminal 4 via transmission medium 2 or 
recording medium 3. Similarly, a computer program for performing fine splitting processing or 
splitting polygon data generation processing can be provided to data provision device 1 via optical 
disk, optomagnetic disk, or other recording medium, or may be provided via Internet, satellite 
circuit, or other transmission medium. 
25 Splitting polygon data generation processing or fme splitting processing, besides being done 

by having a processor execute a computer program, may be done on dedicated hardware. 

In this embodiment, the three-dimensional image is displayed on display unit 1 6 (display 
unit 26), which is a CRT, liquid crystal display, or the like, but this invention also applies to cases 



in which, for example, the three-dimensional image is printed by a printer (two-dimensional output 
device). 

To summarize the effects of the present invention it should be noted that with the image 
processing device image processing method and program distribution medium of the present 
5 invention, interpolated lines which are lines that interpolate between two vertices are determined 
from interpolation vectors used for determining lines that interpolate between a given vertex and 
another vertex in the vertices of a unit graphic fomi, and from the coords 
interpolated points which are points on interpolated Imes are determined as vertices of sub-unit 
graphic forms. Therefore, for example, sub-unit graphic forms that constitute a smooth shape can 
1 0 be obtained from rough unit graphic forms. 

The image processing device splits a unit graphic form into multiple sub-unit graphic forms 

^1 by processing an image defined by a combination of unit graphic forms, and has an interpolated 

■ 

4 line computation means (for example, program processing steps S3 1 through S35 in Figure 34, or 
W program processing steps S41 through S45 in Figure 35) which detemiines the interpolated line that 

1 513 is the line that interpolates between two vertices from the interpolation vector used for determining 
h the line that interpolates between a given vertex and aiiother v^ 

In graphic forms and from the coordinates of the vertices, and an interpolated point computation 

5 means (for example, program processing step S36 in Figure 34, or program processing steps S46 in 
Figure 35) that determiaes, as the vertices of sub-unit graphic forms, interpolated points that are 

20 points on an interpolated line. 

The image processing device ftirther has an interpolation vector computation means (for 
example, program processing step S36 in Figure 34) that determines the interpolation vectors at 
interpolated points on interpolated line 1 from interpolation vectors at vertices 1 and 2 and 
determines interpolation vectors at interpolated points on interpolated line 2 from interpolation 

25 vectors at vertices 3 and 4, and the interpolated line computation means determines interpolated 
line 5 from interpolation vectors at interpolated points on interpolated lines 1 and 2 and from the 
coordinates of the interpolated points. 
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That image processing device further comprises an interpolation vector computation means 
(for example, program processing step S36 in Figure 34) which determines, from interpolation 
vectors at the vertices, the interpolation vector to be used for determining the line that interpolates 
between one interpolated point and another interpolated point among the interpolated points. 
5 The image processing device of that embodiment further comprises a correction means (for 

example, program processing step S37 in Figure 34) that corrects the interpolation vector at an 
interpolated point determined by the interpolation vector computation means. 

If the image is a three-dimensional image the image processing device has a rendering 
means (for example, rendering unit 25 in Figure 3) that renders sub-unit graphic forms, 
10 With the im^e being a three-dimensional image, the interpolated line computation means 

has an angle computation means {for example, program processing steps S31 through S3 3 in Figure 
* 34) which determines angle 1 or2fbrmedby the straight line that joins one vertex and aiiother 
W vertex interpolated by an interpolated line, which is a Bezier curve, and each projection of the 

y 

U straight line onto a plane perpendicular to the interpolation vector at the one vertex or other vertex, 
which is a plane that includes the one vertex or the other vertex; a distance computation means (for 
% example, program processing step S34 in Figure 34) that determines, based on angles 1 and 2, a 
:}{ control edge length 1 or 2, which is the distance from the one vertex or the other vertex to control 
^ \ point 1 or 2 of the Bezier curve; and a Bezier curve computation means (for example, program 
processing step S35 in Figure 34) that determines the Bezier curve as the interpolated line that 
20 interpolates between the one vertex and the other vertex by determining, based on control edge 
length 1 or 2, each control point 1 and 2, 

If the coordinates of the vertices of the unit graphic forms and the interpolation vectors are 
recorded on a recording medium, the device ftirther has a playback means (for example, 
reception/playback device 2 1 in Figure 3) that plays back from the recording medium the 
25 coordinates of the vertices and the interpolation vectors. 

If the coordinates of the vertices of the unit graphic forms and the interpolation vectors are 
transmitted via a transmission route, it further has a reception means (for 
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reception/playback device 2 1 in Figure 3) that receives the coordinates of the vertices and the 
interpolation vectors that are transmitted via the transmission route. 

If the image is a three-dimensional image, and the device further comprises an operation 
means (for example, input unit 28 in Figure 3) that is operated when a prescribed input is given, a 
5 geometry processing means (for example, geometry processing unit 23 in Figure 3) that reads data 
concerning unit graphic forms from a recording medium and perfomis geometry processing on the 
data in accordance with the input from the operation means, a conversion means (for example, 
rendering unit 25 in Figure 3) that converts sub-unit graphic forms obtained by splitting the unit 
graphic forms resulting after said geometry processing into ones in the coordinate system of a two- 
1 0 dimensional output device, and a rendering means (for example, rendering unit 25 in Figure 3) that 
m renders the sub-unit graphic forms converted by the conversion means. 

With the image processing device the image processing method and the program 

4? distribution medium of another embodiment of the present invention as described above, 

III 

iij interpolation vectors are generated which are used for deterxnining interpolated lines that are lines 
1 ifi which interpolate between a given vertex and another vertex in the vertices of a unit graphic form 
%: input by an operation means being operated. Therefore, for example, smooth shapes can be 
^ constituted by using these mterpolation vectors. 

tfl This image processing device, which is an image processing device that processes images 

defined by a combination of unit graphic forms, inchides an operation means (for example, input 

20 unit 1 1 in Figure 2) that is operated when unit graphic forms are input; an interpolation vector 
generation means (for example, data processing unit 12 in Figure 2) that generates interpolation 
vectors used for determining the interpolated line that is the line that interpolates between a given 
vertex and another vertex in the vertices of the unit graphic forms that are input by operation of 
the operation means; and a provision means (for example, transmission/recording device 1 8 in 

25 Figure 2) for providing the coordinates of the vertices of the unit graphic forms and the 
interpolation vectors. 

The image processing device of another embodiment further includes a splitting means (for 
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example, splitting processing unit 14 in Figure 2) that splits a unit graphic form into multiple sub- 
unit graphic forms based on the coordinates of the vertices and the interpolation vectors, and a 
rendering means (for example, rendering unit 15 in Figure 2) that renders the sub-unit graphic 
forms. The splitting means includes an interpolated line computation meaiis (for exampk^ 
5 processing steps S3 1 through S35 in Figure 34, or program processing steps S41 through S45 in 
Figure 3 5) that determines interpolated lines based on the coordinates of the vertices and the 
interpolation vectors, and an interpolated point computation means (for example, program 
processing step S3 6 in Figure 34, or program processmg step S46 in Figure 35) that determines, as 
the vertices of the sub-unit graphic forms, interpolated points that are points along the interpolated 
1 0 lines. The splitting means further has an interpolation vector computation means (for example, 
O program processing step S3 6 in Figure 34) that determines, from the interpolation vectors at the 
^ vertices, interpolation vectors to be used for determiniiig the line that interpolates between a given 
lif interpolated point and another interpolated point among the interpolated points. The splitting 

s ., ^ 

2 means further has a correction means (for example, program processing step S37 in Figure 34) that 
1^^" corrects the interpolation vectors at interpolated points determined by the interpolation vector 
y computation means. 

W With the data distribution medium of the present invention there are provided at least, as 

O data concerning the image, the coordinates of the vertices and interpolation vectors at the vertices 
that are obtained by generating interpolation vectors used for determining interpolated lines that are 
20 lines that interpolate between a given vertex and another vertex in the vertices of a unit graphic 

form if the unit graphic form is input. Therefore, for example, smooth shapes can be constituted by 
using these interpolation vectors and the coordinates of the vertices. 

With the image processing device of yet another embodiment of this invention as described 
above, interpolation vectors are generated which are used for determining interpolated lines which 
25 are lines that interpolate between a given vector and another vector in the vertices of a unit graphic 
form input by an operation means being operated. The interpolated lines are determined from the 
coordinates of the vertices and the interpolation vectors of the unit graphic forms, and the 
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interpolated points that are points on interpolated lines are determined as sub-unit graphic forms. 
Therefore, for example, sub-unit graphic forms that constitute smooth shapes can be obtained from 
rough unit graphic forms. 

The image processing device of this yet another embodiment has a provision device that 
5 provides data concerning images and a client device that receives data from the provision device 
and splits unit graphic fomis into multiple sub-unit graphic forms; the provision device has an 
operation means (for example, input unit 1 1 in Figure 2) that is operated when unit graphic forms 
are input, an interpolation vector generation means (for example, data processing unit 12 in Figure 
2) that generates interpolation vectors used for determining the interpolated line that is the line that 
1 0 interpolates between a given vertex and another vertex among the vertices of the unit graphic forms 
m input by operation of the operation means, and a provision means (for example, 
fi transmission/recording device 1 8 in Figure 2) that provides to the client terminal the coordinates of 
J the vertices of unit graphic forms and the interpolation vectors; and the client device has an 
W interpolated line computation means (for example, splitting processing unit 24 in Figure 3) that 
l ii detemiines interpolated lines from the coordinates of the vertices of unit graphic forms and 
0 interpolation vectors, an interpolated point computation means (for example, splitting processing 
ry unit 24 in Figure 3) that determines, as the vertices of the sub-unit graphic forms, interpolated 
S points that are points along the interpolated lines, a conversion means (for example, rendermg unit 
^ 25 in Figure 3) that converts sub-unit graphic forms into ones in the coordinate system of a two- 
20 dimensional output device, and a rendering means (for example, rendering unit 25 in Figure 3) that 
renders the sub-unit graphic forms converted by the conversion means. 
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